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Chapter 1 



Introduction 



An overview 

This work is rooted in two important areas of mathematics. One of them is the optimal 
control theory with its central theorem, the celebrated Pontryagin maximum principle 
(PMP). The second is the theory of Lie algebroids and, in particular, its applications to 
geometric mechanics. 

Note that the PMP may be regarded as an extension of the calculus of variations 
to a much bigger class of problems. On the other hand, the language of Lie algebroid 
theory has proved to be a very fruitful tool in mechanics and variational calculus allowing, 
for example, to treat standard systems and systems reduced by inner symmetries in a 
unified way, and to have a deeper insight into the nature of the Lagrange and Hamilton 
formalisms. Therefore, we may think of the PMP and the algebroidal formulation of the 
Lagrange formalism as two different extension of the standard calculus of variations — 
the first by generalising the class of problems, the second by generalising the geometric 
context. 

Consequently, it is a natural idea to unify these two generalisations and formulate the 
PMP in the language of algebroids. Some attempts in this direction has already been 
made ( [Cortes fc Martinez, 20041 [Martinez, 20041 [Crabowska fc Crabowski, 2008| ), yet 



so far there is no satisfactory solution. In this work we tried to give a full solution of 
the problem in a possibly general context both geometrical and technical. Namely, we 
formulate our extension of the PMP for optimal control problems (OCPs) on almost Lie 
algebroids (objects generalising Lie algebroids), we work with bounded measurable con- 
trols and absolutely continuous base trajectories, and we consider quite general boundary 
conditions. Note that, according to [Agrachev &: Gamkrelidze, 2006 , the PMP was never 



a subject of any substantial generalisation, apart from the technical ones discussed in the 
next subsection. 



Optimal control theory 

The PMP, proved in 1956 by L. Pontryagin and his collaborators [Pontryagin et ai, 1962 , 
was an answer to the problem of finding solutions of optimal problems of new type which 
could not be treated with the standard variational methods. Roughly speaking, we are 
interested in minimising the standard action functional of the calculus of variation (on a 
manifold M), but we restrict our attention to trajectories x{t) G M whose velocities can 
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be controlled, i.e., they belong to a given subset of TM. The PMP (Theorem IC.2P ex- 
presses the necessary conditions for optimality in the language of the canonical symplectic 
structure of the cotangent bundle T*M. A short account of the result and the historical 
discussion of its development can be found in [Agrachev fc Gamkrelidze, 2006 . 



From its appearance, the PMP became an object of intensive studies both on theoretical 
and applied level. As a technique it is used in a wide range of disciplines which include 
engineering, aerospace, robotics, medicine, economics, and other (see the references in 
[Barbero-Lifian &: Mufioz-Lecanda, 2009 for more details), and as such is used for solving 
concrete practical problems. 

The theoretical development concentrated in several directions. One of them, ini- 
tiated by Clarke in the 70s, was devoted to relaxing the assumptions under which the 
result holds. This research, undertaken mostly by Clarke, loffe, Loewen, Mordukhovich, 
Rockafellar, and Vinter, used the tools provided by the non-smooth analysis and led 
to generalisations of the PMP among which the most important is [Clarke, 1976| . The 
monograph [Clarke, 2005b discusses this topic in details (see also [Clarke, 2005a for a 
brief account of the most important results). 

In the 60s there was a search for a simple proof of the PMP. The original argument 
of Boltyanskii ( [Pontryagin et ai, 1962| ) is long, and some people believed that a shorter 
reasoning based on variational methods can be found. Such a proof does not exists so far, 
even though some simpler versions of the PMP can be proven quite elementary. Essentially, 
there are two kinds of proofs of the PMP. The first is the original one which uses needle 
variations — a tool developed by Boltyanskii especially for this purpose. The other argu- 
ment was given by [Gamkrelidze et ai, 1978| and is based on the concept of generalised 
controls. The research in this area concentrated mostly on translating the proof expressed 
originally in the language of differential equations to the language of differential geometry. 
Recent results [Barbero-Lifian &: Mufioz-Lecanda, 2009 Agrachev Sachkov, 2004 show 



a deeper understanding of the geometric origins on the PMP and connection between 
optimality and accessibility. 

The last topic is closely related to the problem of abnormal extremals. These are 
the solutions of the OCRs which do not depend on the cost function but on the ge- 
ometry of the considered system only. For a long time, until the discovery of coun- 
terexamples in sub-Riemannian geometry [Montgomery, 1994| , people believed that such 
curves cannot be optimal. Since then this area became a subject of a growing in- 
terest [Agrachev fc Sarychev, 1996 Agrachev fc Sarychev, 1998 Bonnard Trelat, 2001 



Langerock, 2003a Langerock, 2003b 



Algebroids and their application to mechanics 



Lie algebroids were introduced by Pradines in the mid 60s as infinitesimal objects as- 
sociated with Lie groupoids, per analogy to Lie algebras and Lie groups. In a se- 
ries of short articles [Pradines, 1966 Pradines, 1967b Pradines, 1967a Pradines, 1968| 
he announced a very general program of developing the Lie theory for Lie groupoids. 
The progress was not very fast until the 80s, when Weinstein introduced the notion 
of a symplectic groupoid to Poisson geometry [Weinstein, 1987 



Since then Lie al- 
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gebroids and Lie groupoids has become objects of great significance in this field (see 
e.g. ICoste et a/.,T987l [WeuTstein, IQSSj [Courant, 1990| [Weinstein fc Xu, 1991i|Xu, 1992 



Cattaneo fc Felder, 2004 Crainic fc Fernandes, 2004] ). The main reason of this is the 
fact that with every Poisson manifold P one can naturally associate a Lie algebroid struc- 
ture on the cotangent bundle T*P — y P (on the other hand Lie algebroids are objects 
dual to linear Poisson structures). Therefore many problems of Poisson geometry can 
be translated into the language of Lie algebroid theory. Other applications of Lie alge- 
broids appeared in the theory of foliations (e.g. [Pradines, 1966 Winkelnkemper, 1983 



Moerdijk & Crainic, 2001 Moerdijk fc Mrcun, 2003] ) and, for locally trivial Lie alge- 
broids, in the theory of connections (cf. [Mackenzie, 1987] ). 

In all these applications the problem of integrability of Lie algebroids posted al- 
ready by Pradines plays a central role. For example the existence of a symplectic re- 
alisation of a Poisson manifold P is equivalent to the integrability of the associated 
Lie algebroid T*P — y P. The integrability problem was attacked by many authors 
and partial solutions for some special classes of Lie algebroids has been obtained (see 
[Almeida, 1980| [Almeida fc Kumpera, 198T| [Almeida fc Molino, 1985| [Mackenzie, T987 



Cattaneo fc Felder, 2004] ) until it was completely solved by [Crainic fc Fernandes, 2003 
A detailed discussion of this topic is given in Appendix lA.ll 

We are interested mostly in applications of the algebroid theory to mechanics which was 
also a Weinstein's idea [Weinstein, 1996] (see also [Libermann, 1996| ). Since then the topic 
was studied in different contexts by many authors ( [Cortes et al, 20061 [Cortes & Martinez, 2004| 



Leon et a/.,^005|[Martmez, 2001ai [Martinez, 200lb| [Martinez, 20051 [Martinez, 20071 [Martinez, 2008[ ). 
It was observed a little bit later, following the approach to analytical mechanics pro- 
posed by Tulczyjew [Tulczyjew, 1974 Tulczyjew fc Urbanski, 1999| , that geometrical me- 
chanics, together with the Euler-Lagrange and the Hamilton equations, constrained 
dynamics, etc., can be developed based on more general objects than Lie algebroids 
( [Grabowska et ai, 2006 Grabowska fc Grabowski, 2008| ). They were introduced in 
[Grabowski fc Urbanski, 1999| under the name (general) algebroids. This generalisation 
turns out to be of practical use, as systems of mechanical type with nonholonomic con- 
strains allow a nice geometrical description in terms of skew- algebroids [Grabowski et ai, 2009 
which do not have to satisfy the Jacobi identity in general. 



Reduction in optimal control theory 

As a motivation, before formulating our main results, let us discuss a reduction by inner 
symmetries of a control or mechanical system. It is a well-known phenomena in analytical 
mechanics and control theory that symmetries of a system lead to reductions of its degrees 
of freedom. It is also well-understood that such a reduction procedure is not purely 
computational but is associated with a reduction of the geometrical structures hidden 
behind. 

A typical situation considered in control theory is a control system F : P x U — y TP 
on a manifold P (with U being the set of control parameters) which is equivariant w.r.t. 
the action of a Lie group G on P and the induced action on TP. If this action is free and 
proper, we deal in fact with a G-invariant control system on a principal bundle P ^ P/G. 
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Introducing a G-invariant cost function L : P x U — Y M, one ends up with a G-invariant 
optimal control problem on a principal bundle P ^ P/G. 

There are basically two ways of obtaining optimality necessary conditions for such a 
problem. In the first, one takes the PMP for the unreduced system on P and performs 
the Poisson reduction of the associated Hamiltonian equations. For the simple case of an 
invariant system on a Lie group P = G (see eg. [Jurdjevic, 1997| ) one obtains a system 
on the Lie algebra Q = TG/G, and the reduced Hamilton equations are the Hamilton 
equations obtained by means of the Lie-Poisson structure on g*. The best known example 
of this type is probably the reduction for the rigid body in analytical mechanics: from 
the cotangent bundle T* SO (3) of the group SO (3) playing the role of the configuration 
space to the linear Poisson structure on so (3)* — the dual of the Lie algebra so (3). Similar 
situation appears for homogeneous spaces [Jurdjevic, 1997 and general principal bundles 
[Martinez, 2004 Martinez, 2007 . The reduced system lives on the bundle TP/G which is 



canonically a Lie algebroid, called the Atiyah algehroid of P, and the reduced Hamilton 
equations are associated with the linear Poisson structure on T*P/G (equivalent to the 
presence of a Lie algebroid structure on TP/G). In this approach one obtains a version 
of the PMP, yet the Hamiltonian reduction seems to be purely computational and a big 
part of the geometry of the problem remains hidden. 

The second approach, called the Lagrangian reduction, was introduced by Marsden 
and his collaborators (see for example [Cendra et ai, 1998| ) in the context of analytical 
mechanics. Here, one uses the reduced data / : P/GxU — > TP/ G and / : P/GxU — > M, 
and the reduced variations (homotopies) to obtain a reduced version of the Euler-Lagrange 
equations. In this approach it becomes clear that the reduction of the variational principle 
is not only the reduction of the data and geometrical structure, but also a reduction of 
variations (homotopies) — this is most clearly stated in [Cendra et ai, 1998 for the case 
of an invariant system on a Lie group. By means of the Lagrangian reduction one can 
obtain various results such as Euler-Poincare equations and Hammel equations. Despite of 
this advantages, the Lagrangian reduction seems to be useful rather in mechanics than in 
control theory, as one requires the geometry of the set of controls U and controls itself being 
very regular {U should be at least an affine subspace of M", and controls differentiable), 
so accepts no discontinuity, switch-on-switch-off controls, etc. 



The main result 

The aim of our work is to extend the fundamental theorem of optimal control — the PMP — 
to the setting of almost Lie (AL) algebroids — geometrical objects generalising Lie alge- 
broids. 

Since Lie algebroids are infinitesimal (reduced) objects of (local) Lie groupoids (like 
Lie algebras are for Lie groups), we are motivated mostly by the Lie groupoid Q — Lie 
algebroid A{Q) reduction. Obviously, a reduction of an invariant control system on a Lie 
groupoid should lead to a system on the associated Lie algebroid. An example of such a 
situation was discussed in the previous subsection, where an invariant control system on 
a principal bundle lead to a system on the associated Atiyah algebroid. 
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What is more, similarly to the scheme of the Lagrangian reduction, we should also 
reduce the variations (homotopies) from Q to A{Q). This will motivate the abstract def- 
inition of the homotopy of admissible paths on an AL algebroid (algebroid homotopy). 
Finally, reducing an invariant OCP on the Lie groupoid Q would not be complete with- 
out reducing the boundary conditions as well. The idea is to substitute fixed-end-points 
boundary conditions on Q by fixed-homotopy-class conditions. These two are closely re- 
lated (see Chapter H] for a detailed discussion) and equivalent if Q is a-simply connected 
(the homotopy class of a curve on a simply connected manifold is uniquely determined by 
its end-points). Now, since homotopies in Q correspond to algebroid homotopies in A{G), 
we can express the reduced boundary conditions in A{Q) as fixing the algebroid homotopy 
class of the trajectory of the reduced control system. A similar construction can be made 
also for more general boundary conditions. 

At the end, for a general AL algebroid E, we can formulate an analog of the OCP 
which, in the case of an integrable algebroid E = A{Q), turns out to be an invariant OCP 
reduced from Q. Let us note that our understanding of algebroid homotopies and homotopy 
classes is closely related to that of Crainic and Fernandes [Crainic fc Fernandes, 2003] , 
where similar techniques were used to generalise the Third Theorem of Lie and integrate 
Lie algebroids. However, our framework is much more general, as we no longer remain in 
the smooth category. 

To explain briefly the result, let us note that an AL algebroid is a vector bundle 
r : E — y M together with a vector bundle map p : E — y TM (anchor) and a skew- 
symmetric bilinear bracket [■, ■] on the space of sections of E which satisfy certain compat- 
ibility conditions. The algebroid structure on E is equivalent to the presence of a certain 
linear bi- vector field 11 on the dual bundle E*. Note that the bivector field 11 defines the 
Hamiltonian vector field Xh associated with any C^-function H on £"*, defined in the 
standard way as the contraction Xh = ^-d^n. 

Standard examples of AL (in fact Lie) algebroids are: the tangent bundle E = TM — y 
M with p = idxA/ and the Lie bracket of vector fields, and a finite-dimensional real Lie 
algebra E = g with the trivial anchor map (M is a single point in this case) and the Lie 
bracket on g. In the first case, 11 is the canonical Poisson tensor on T*M, whereas in the 
second — the Lie-Poisson structure on g*. An example of an AL algebroid which is not a 
Lie algebroid is given by any real vector bundle with a smooth family of skew-symmetric 
bilinear (but not Lie) operations on its fibers. 

On the bundle E we can consider admissible paths; i.e., bounded measurable maps 
a : [to,ti] — y E such that the projection x{t) = r(a(t)) of a(t) onto M is absolutely 
continuous (AC) and x{t) = p{a{t)) a.e. On admissible paths we have an equivalence 
relation a ^ b interpreted as a reduction of homotopy equivalence (with fixed end-points). 
Note that equivalent paths need not to be defined on the same time interval. For an 
admissible path a, we denote with [a] the equivalence class of a. 

A control system is defined by a continuous map f : M x U — E, where f/ is a 
topological space of control parameters such that, for each u & U, the function f{-,u) is a 
section of class of the bundle E. Every admissible control, i.e., a bounded measurable 
path u{t) in U, gives rise to an absolutely continuous path in M defined by the differential 
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equation 

x(t) = p(/(x(t),M(t))), 

and to an admissible path a{t) = f{x{t),u{t)) covering x{t). We will call a{t) the tra- 
jectory of the control system and the pair {x{t),u{t)) — the controlled pair. An optimal 
control problem for this control system is associated with a fixed homotopy class [a] of an 
admissible path a and a cost function L : M x — >■ M. The problem is to find a controlled 
pair {x{t),u(t)) with t G [toj^i] (fhe time interval is to be found as well) such that 

the integral / M(t))dt is minimal among all controlled pairs (x,u) for 

Jto (P) 

which the i?-homotopy class of the trajectory f{x(t),u(t)) equals [a]. 

Our main result is the following. 

Theorem 1.1. Let {x(t),u(t)) , with t G [toj^i]? be a controlled pair solving the optimal 
control problem ([P]). Then there exists a curve ^ : [to;^i] — ^ E* covering x(t) and a 
constant f < such that 

—0 

• the curve C,{t) is a trajectory of the time- dependent family of Hamiltonian vector 
fields Xut, Ht{x,^) := H {x , , u(t)) , where 

H{x, ^, u) = (f {x, u),0 + ^^L (x, u) ; 



• the control u satisfies the "maximum principle" 

H{x{t),at),u{t)) = snpH{x{t),^{t),v) 

veu 

and H{x(t),C,{t),u{t)) = at every regular point t of u; 

• if^^ = 0, then the covector ^{t) is nowhere-vanishing. 

We have also developed a version of this result for general boundary conditions. These 
can be expressed by means of two smooth algebroid morphisms $o • TSq — > E and 
$1 : TSi — )■ E. In the integrable case E = A{Q) it is convenient to think of $o and $i 
as of two smooth maps $o '■ Sq — > Q and $i : 5*1 — > Q reduced to A{Q). Now we can 
formulate the relative OCP by substituting in the problem ([P]) the algebroid homotopy 
class [a] by the relative algebroid homotopy class [a] mod($0) "^i)- Here the relative class 
can be understood as a reduction of a homotopy in with end-points in the images Im $o 
and Im$i, to the algebroid A{Q). 

For a solution of the problem described above we can repeat Theorem 11.11 with addi- 
tional transversality conditions, namely, that the covectors ^(to) and ^(ti) annihilate the 
images Im$o and Im<l>i, respectively. 
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Discussion of the main result 

The above result looks quite similar to the standard PMP. Indeed, in the case E = TM 
we obtain the PMP. The only difference is that the fixed-end-point boundary condition 
are substituted by the fixed-homotopy-class condition. However, this makes no essen- 
tial difference, as is discussed in detail in Chapter HI For the case of an integrable 
Lie algebroid E = A{Q) our version of the PMP can be understood as a general re- 
duction scheme for invariant OCPs on Lie groupoids. In particular, the theorem cov- 
ers the known results on Hamiltonian reduction of Jurdjevic [Jurdjevic, 1997 and Mar- 



tinez [Martinez, 2004 Martinez, 2007 , and Lagrangian reduction [Cendra et al., 1998 



(see Chapter [6] for details). It is, however, worth mentioning that in our approach the 
reduced and the unreduced PMPs are parts of the same universal formalism. Roughly 
speaking, we have generalised the geometrical context in which the PMP can be used. 
The technical setting remains quite general — we work with bounded measurable controls 
and AC base trajectories. Moreover, since AL algebroids do not come, in general, from 
reductions, our result admits a wider spectrum of possible applications. An attempt in 
this direction can be found in the last example of Chapter [6l Finally, note that a version 
of Theorem 11.11 for general boundary conditions admits arbitrary algebroid morphisms 
$0 '■ T^o — 7- E and $1 : T^i — > E. In the integrable case E = A{Q) these correspond 
to arbitrary smooth maps $0 '■ Sq — > Q and $1 : Si — > Q. On the other hand, in litera- 
ture, when speaking about general boundary conditions one usually restricts attention to 
immersions only. 

The original contributions of the author includes: 

• a detailed study of the notion of an algebroid homotopy and algebroid homotopy 
classes in Chapter |3l 



The definition of the Lie algebroid homotopy appeared in [Crainic fc Fernandes, 2003 



It was given it terms of time-dependent algebroid sections and connections and 
though was not very intuitive. We extended the notion of the algebroid homo- 
topy to almost Lie algebroids, extended it to measurable class, and reformulated 
the definition to emphasise the similarities with the standard notion of homo- 
topy. 

We introduced the notion of a relative algebroid homotopy class. 

We gave a new interpretation of algebroid homotopies in terms of a Stokes-like 
formula and also extended the well-known interpretation of algebroid homoto- 
pies as reduced homotopies of a groupoid to the measurable class (Theorem 

ED. 

We ask a question about existence and uniqueness of algebroid homotopies. 
A uniqueness result (Lemma 13. 3p is a simple consequence of certain results 
from the theory of differential equations. On the other hand, the existence is 
strongly connected with the axioms of AL algebroid. We prove Lemma 13.121 
which states that only for AL algebroids every sufficiently regular one-parameter 
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family of admissible paths generates an algebroid homotopy (for a given initial- 
point algebroid homotopy). This result, which in its infinitesimal and smooth 
version appeared earlier in [Grabowska fc Grabowski, 2008| , distinguishes AL 
algebroids from more general objects of similar nature (skew-algebroids or ge- 
neral algebroids). 

— We study further properties of algebroid homotopies in Section 13.21 These in- 
clude Lemma 13. 17^ which shows the behaviour of algebroid homotopy classes 
under reparametrisation, and Lemma I3.15[ which compares algebroid homoto- 
pies with and without fixed end-points. 

formulating the OCPs in the language of AL algebroids in Chapter |3J 

— We proposed to express boundary conditions of the OCPs in terms of algebroid 
homotopies. 

— We gave an interpretation of these new OCPs and, in particular, studied in 
detail their relation to standard OCPs. 

— We proposed to express general boundary conditions in the OCP in terms of 
algebroid morphisms rater than submanifolds. 

formulating a version of the PMP in the language of AL algebroids for fixed end- 
points and general boundary conditions (Theorems 15.11 and | 

proving these theorems in Chapters [3-[9l 



The proof, in principle, imitates the argument of Boltyanskii [Pontryagin et al., 1962 



There are, however, technical difficulties connected with using the language of 
AL algebroids. These appeared mostly in two places. In the proof of Theo- 
rem [73] we used reparametrisation and composition of algebroid homotopies to 
study the impact of needle variations on the trajectories of a control system. 
In Lemma 18.11 to prove the existence of an admissible path realising a certain 
algebroid homotopy class we had to pass through infinite-dimensional Banach 
spaces. The reason for that is the following: AL algebroids are, in general, not 
integrable, and hence homotopy classes cannot be represented by points on a 
finite dimensional manifold (they are just cosets in a big space of curves). Our 
idea was to semi-parametrise these classes by a finite-dimensional space and 
reduce the reasoning to a finite dimensional topological problem. 

Moreover, the standard proof [Pontryagin et al, 1962| like most of the other 
proofs in literature (perhaps apart from [Barbero-Lifian fc Mufioz-Lecanda, 2009| ) 
contains smaller or greater gaps. We put much effort to explain all the details 
and make the reasoning self-contained. 



A significant part of this work is based on [Grabowski fc Jozwikowski, 2011 . In this article 



we concentrated only on OCPs with fixed-end-point boundary conditions. Therefore all 
parts concerning general boundary conditions, in particular Definition 13.10^ Theorem 15.21 
and its proof including Lemma and Section I^T^ and parts concerning an interpretation 
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of relative algebroid homotopies and an interpretation of the OCP (IP reip (in Chapter Hj), 
has not been pubhshed before. Also broad parts of [Grabowski Jozwikowski, 2011| were 
reformulated to make the argument more understandable. 

Organisation of the manuscript 

The first major part of this work is intended to give all important definitions and motiva- 
tions which allow to define OCPs on an AL algebroid in Chapter H] and finally state our 
main results in Chapter O We start with a brief introduction of AL algebroids in Chapter 
[2j In Chapter [3] we concentrate on algebroid homotopies which are crucial in our work. 
Much effort was made to give a satisfactory definition in both smooth and measurable 
setting, and later to motivate this definition, mainly by Lie groupoid — Lie algebroid re- 
duction arguments. We also derive all properties of algebroid homotopies which will be 
used later in the proof of our main results. Finally, in Chapter HJ we define and motivate 
algebroid OCPs. Much attention is payed to algebroid homotopies naturally associated 
with a control system on an AL algebroid. This leads to the notion of a parallel transport. 

In Chapter [6] we derive some known results on reduction in optimal control theory 
and variational calculus by means of our result. In particular we formulate the version 
of the PMP for invariant OCPs on principal bundles and use it to study the example of 
the falling cat problem of [Montgomery, 1990] . Some attention is payed to the problems 
of the calculus of variations on principal bundles. We obtain the results on Lagrangian 
reduction, Hammel equations and Euler-Poincare equations as a special case. We also 
derive the generalised Euler-Lagrange equations on a general AL algebroid. 

The second mayor part, consisting of Chapters [THHl contains the proof of Theorem ll.il 
In Chapter [7| we define needle variations and a cone KJ^ of infinitesimal variations of the 
trajectory of the control system. The geometry of this cone is studied in detail in Chapter 
[9l using technical results proved in Chapter [HI Then we can follow [Pontryagin et ai, 1962| 
to derive the necessary conditions for optimality from the geometric properties of KJ^ along 
the optimal trajectory. 

Parallel to the proof of Theorem 1 1.1 1 we prove its version with general boundary condi- 
tions. Usually this requires just a minor modification of the arguments used. We decided 
to give two proofs in spite of the fact that Theorem II. II is just a special case of the version 
with general boundary conditions. We believe that in this way the already complicated 
reasoning is easier to follow. Moreover, this is the typical way the proof of the PMP is 
presented in literature. 

In the main part of this work we assume that the reader is familiar with basics of control 
theory, geometry of convex sets, topology, theory of ODEs in the sense of Caratheodory, 
and basics of the theory of Lie groupoids. However, the reader who is not confident with 
these topics can find necessary information in Appendixes RHDI (we give the references 
when necessary). We believe that our presentation is self-contained. The Appendixes con- 
tain also some minor technical results which are used in the argument, yet their derivation 
in the main text would make the presentation less clear. 



Chapter 2 



Almost Lie algebroids 



This chapter is concerned with some basic definitions and constructions from the theory of 
algebroids. We begin with the definition of a skew-algebroid and an almost Lie algebroid 
as a special case. Later we introduce the notion of a Hamiltonian vector field and the 
complete lift of an algebroid section. The characterisation of skew-algebroids in terms of 
exterior differential operators is used to define a morphism of algebroids. This, in turn, 
leads to the notion of an admissible path. We end this chapter with the construction of 
the product of two algebroids. 

Let us note that many aspects of the theory of algebroids are not present in this intro- 



ductory chapter. The interested reader should confront [Mackenzie, 2005 
Grabowski & Urbanski, 19991 ISilva & Weinstein, 1999 



Mackenzie, 1987 



DifFerentiable manifolds and vector bundles 

In this work we use the following notation and conventions of differential geometry. By 
M we denote a smooth n-dimensional manifold, by tm '■ TM — )■ M the tangent vector 
bundle, and by 7rj\/ : T*M — )■ M the cotangent vector bundle of M. When passing to a 
local description we will use a coordinate system (x'^), a = 1, . . . ,n in M. We have the 
induced (adapted) coordinate systems {x°',x^) in TM and {x°',pi,) in T*M. 

More generally, let r : — > M be a vector bundle, and let n : E* ^ M be the 
dual bundle. Choose (ei,...,em) — a basis of local sections of r : E ^ M, and let 
(e^, . . . , e™) be the dual basis of local sections of n : E* — y M. We have the induced 
coordinate systems: = i(e*) in E, and {x°' , C,i) , C,i = L{ei) in E*, where the linear 

functions ^(e) are given by the canonical pairing i(e)(t'^.) = (^e{x),Vx)- The null section of 
r : E — > M will be denoted by 6, and 6^ will stand for the null vector at point x G M. 

In this work the summation convention is assumed. 



Almost Lie algebroids 

Definition 2.1. Let M be a manifold and r : E — > M a vector bundle over M. A skew- 
algebroid structure on is a vector bundle morphism p : E — > TM over M, called the 
anchor map, and a skew-symmetric bilinear bracket [-, ■] : Sec{E) Sec(£') — > Sec{E) 
on (local) sections of r, which satisfies the Leibniz rule 

[XJ-Y] = f[X,Y]+p{X){f)Y (2.1) 
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for every X, F G Sec(E) and / G C°°(M). 

If, additionally, the anchor map is an algebroid morphism, i.e., 

p([X,F]) = [p(X),p(F)]tm, (2.2) 

we will speak of an almost Lie algebroid {AL algebroid briefly). 

If, in addition to (12. ip and (12. 2p . the bracket satisfies the Jacobi identity (in other 
words, the pair (Sec(i?),[-, ■]) is a Lie algebra), we speak of a Lie algebroid. 

In local coordinates (x",i/*), introduced at the beginning of this chapter the structure 
of an algebroid on E can be described in terms of local function p"(x) and c*^(x) on M 
given by 

p{ei) = pi{x)d^a and [ei,ej] = c|(x)efc. 

The skew-symmetry of the algebroid bracket results in the skew-symmetry of c*;. in lower 
indices, whereas condition (12. 2p reads as 

In the context of mechanics it is convenient to think about an algebroid as a genera- 
lisation of the tangent bundle. An element a E E has the interpretation of a generalized 
velocity with actual velocity v G TM obtained by applying the anchor map v = p{a). The 
kernel of the anchor map represents inner degrees of freedom. 

A basic example of a skew-algebroid structure is the tangent bundle TM of a manifold 
M with the standard Lie bracket and p = idxM- We will refer to this structure as to 
a tangent algebroid. Another natural example is a finite-dimensional real Lie algebra Q 
considered as a vector bundle over a single point with its Lie bracket and the trivial anchor. 

Natural examples of skew-algebroids are associated with systems with symmetries. 
For instance, the Lie algebra g of a Lie group G can be understood as a reduction of the 
tangent bundle TG by the left (or right) action of G. Similarly, for a principal bundle 
G — > P — y M, the reduced bundle TP/G — > M has the structure of an Atiyah 
algebroid. The Atiyah algebroid is a common generalisation of TM and g. This example 
is discussed in more details in Appendix IA.2I More generally, every Lie groupoid Q has 
an associated Lie algebroid A{Q) which can be interpreted as a reduction of a subbundle 
of the tangent algebroid TQ by the right (or left) action of Q. This example is discussed 
in Appendix lA.li 

All the above are examples of Lie algebroids. Natural examples of skew-algebroids 
which are not Lie can be associated with nonholonomically constrained mechanical systems 
IGrabowski et ai, 2009 . 

Hamiltonian vector fields and tangent lifts 

Let us now describe some geometric constructions associated with the structure of a skew- 
algebroid . 
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It can be shown (cf. [Grabowski Urbanski, 1999 Grabowski fc Urbanski, 1997| ) that 
the presence of the structure of a skew-algebroid on E is equivalent to the existence of a 
hnear bivector field II^;. on E*. In local coordinates, on E*, it is given by 

= A d^^ + p^(x)% A d,,. (2.3) 

The linearity of II^;. means that the corresponding mapping 11 : T*E* — > TE* is a mor- 
phism of double vector bundles (cf. [Konieczna &: Urbanski, 1999 Grabowski Rotkiewicz, 2009| ). 
The tensor He* is well recognised in the standard situations: for the tangent algebroid 
structure on TM, it is the canonical Poisson structure on T*M dual to the canonical 
symplectic structure, whereas for a Lie algebra g, it is the Lie-Poisson structure Ilg. on 
g*. Actually, E is a Lie algebroid if and only if II^;. is a Poisson tensor. 

Now we can introduce the notion of a Hamiltonian vector field on E*. Let, namely, 
h : E* — > M be any C^-function. We define the Hamiltonian vector field Xh in an obvious 
way: = L^hllE*- In local coordinates, 

Mx,o = pn^)^^i^A)d.^ + -p-(^)^(^,o) %• (2.4) 

Another geometrical construction in the skew-algebroid setting is the complete lift 
of an algebroid section (cf. [Grabowski fc Urbanski, 1999 Grabowski fc Urbanski, 1997| ). 
For every C^-section X = f^{x)ei G Sec{E) we can construct canonically a vector field 
dT(^) € Sec(T£') which, in local coordinates, reads as 

ax" 

The vector field dT(^) is linear w.r.t. the vector bundle structure Tr : TE — TM (the 
above equation is linear w.r.t. y*). 

Consider the Hamiltonian vector field A't(x) associated with a linear function l{X){-) = 
(^X, on E*. It turns out that fields Xi^(x) and dT(^) are related by 

(dT(X),A',(x)>T, = 0, (2.6) 

where -^^^ : TE Xxa/ TE* — )■ M is the canonical pairing, being the tangent map of 
(-, : E Xm E* — >R (in local coordinates, ((x, y, x, y), (x,^,x,0)t^ = V^^j +y^ii)- 



dT(X)(x,2/) = f\x)pt{x)d,a + ( 2/Vr(x)^(x) + 4(x)y7^(a:) a,.. (2.5) 



Cartan Calculus 

The existence of a skew-algebroid structure on E is equivalent to the existence of exterior 
differential (de Rham) operators 

dE : Sec(A'=E*) Sec(A^+^E*), A; = 0, 1, ... , 

defined by a straightforward generalisation of the Cartan formula 

k 

dEUjiao, ai, . . . , Ofc) = ^(-l)V(ai)a;(ao, . . . ,di, . . . ,ak) 

i=0 

+ (-l)*+^w([ai,aj-],ao,...,ai,...,aj,...,afc), 

l<i<j<k 
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for (jj G Sec(A'^i?*) and oq, ai, . . . , G Sec(i?). 

These operators, in general, needs not be cohomological. In fact, is a Lie algebroid 
if and only ii d\ = AL algebroids, in turn, can be characterized by the condition that 
dlf = for every / G C°°(M) = ^ec{A.^E*). 



Morphisms 

The above concept of the de Rham derivative allows one to give a simpj^ definition of a 
morphism of skew-algebroids. Namely, given skew-algebroids r : E — y M and r : E — y 
M, a bundle map $ : E — > E over ip : M — > M is a skew- algebroid morphism if it is 
compatible with the exterior derivative: 

^*dEe = d^^*e, for every 6 G Sec{A^E*). (2.7) 

Note that a vector bundle map $ does not, in general, induce any map on sections of E, 
while the pull-back $* of sections of E* is always well defined. 

Introduce local coordinates {x°',y'') and and structure functions p°(x), c^^(x) 

and Pi{x), c\^{x) on E and E, respectively. The condition that $ ~ is an 

algebroid morphism reads as 



(x) 9$* (x) ■ ■ , 



(2.8) 



Admissible paths 

Consider an algebroid morphism T]R|/ — > E, where I = [to,ti] C M is an interval. Every 
such map is uniquely determined by the image of the canonical section (t, dt) of TR being 
a smooth curve a{t) in E over the base path x{t) in M. Condition fl2.7p reads as 

p (a(t)) = x{t) for every t G /. (2.9) 

This means that the anchor map coincides with the tangent prolongation of the projection 
x{t) = r(a(t)). The curves which satisfy (12. 9p will be called admissible. In fact, (12. 9p 
also makes sense for non-smooth maps. From now on, by an admissible path on E (or 
briefly E-path) we shall mean a bounded measurable map a : I — y E over an absolutely 
continuous (AC) base path x = r o a : I — y M such that (12. 9p is satisfied a.e. in /. 
In such a case we will speak of measurable E-paths. For more information on measurable 
functions see Section lB.il Observe that from (12. 8p it follows that a morphism of algebroids 
maps admissible paths into admissible paths. 

To explain the meaning of admissible curves, observe that in the case of the tangent 
algebroid TM admissible curves are precisely the tangent lifts of base curves. We will 
show later (cf. Theorem 13. 6p that if an algebroid E is integrable, admissible curves come 
from a reduction of real curves in a Lie groupoid integrating E. 
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Finally, we can introduce the concept of composition of measurable E -paths. Let a : 
[to, ti] — > E and a : [^1,^2] — ^ E be two measurable E'-paths with base paths x = roa and 
X = r o a, respectively. Assume that x{ti) = x{ti) (such paths will be called composable). 
Clearly, the map a : [to, t2] — > E defined by 




a(t) for t < ti, 
a(t) for t > ti 



is another measurable E-path covering the AC curve 




x{t) for t < ti, 
x{t) for t > ti. 



This new E-path will be called the composition of a and a and will be denoted hy a = aoa. 



The product of skew-algebroids 

Given two skew-algebroids (ti : Ei — > Mi, pi, [-, -ji) and (ri : E2 — > M2, p2, [', ■]2) we can 
define a skew-algebroid structure on the product bundle r = T1XT2 : EiX E2 — > Mi x M2. 
The anchor will simply he p = pi x p2 : Ei x E2 — > TMi x TM2 ^ T(Mi x M2). The 
bracket can be defined by equalities 

[plXi,plYi]=pl[Xi,Yi]i, 

[p;X2,p;F2]=p;[X2,F2]2, 
[p*iXi,p;Y2] = 9, 

where Xi,Yi G Sec(-E'i) and X2,l2 ^ Sec(i?2) are sections, p^ : i?i x E2 — > Ei and 
P2 : -E*! x E2 — > E2 are canonical vector bundle projections, and ^ is a null section of r. 
The above equalities can be extended to arbitrary sections by linearity and the Leibniz 
rule (12. ip . Clearly, the canonical projections Ei x E2 — y Ei, with i = 1,2, are algebroid 
morphisms, and if Ei and E2 are almost Lie, then so is their product. 

The local coordinate description of the product Ei x E2 is very simple. If (x", y*) 
and {x"',y'') are local coordinates on Ei and E2, respectively, we can introduce natural 
coordinates {X"^,Y^) = {x°',x°',y^,y'') on Ei x E2. The structure functions Cjj^{X) and 
Rf{X) in these coordinates are trivial on mixed- type terms {Rf = Cj^ = 0, etc.) and the 
same as the structure functions of Ei and E2 on simple-type terms (Cj^(a;, x) = c*^(x), 
Rf{x,x) = pf(x), etc.). 



Chapter 3 



Homotopies of admissible paths 



The notion of the homotopy of E-paths (£'-homotopy) is crucial in this work. It will 
be our main tool to define the boundary conditions for optimal control problem on AL 
algebroids in Chapter HI In this chapter we give a definition of E'-homotopy and study its 
basic properties. 

In the first section much attention is put on interpreting i?-homotopy. In particular, if 
E = A{Q) is a Lie algebroid of a Lie groupoid Q, we show an equivalence of i?- homotopies 
and true homotopies in Q (Theorem 13. 6p . We also interpret i?-homotopies by a Stokes- 
like formula. Finally, we introduce an important notion of E'-homotopy classes and E- 
homotopy classes relative to a pair of algebroid morphisms. 

In the second section we study properties of E'-homotopies. We prove an important 
Lemma 13.121 which states that AL algebroids are characterised by the property that a 
one-parameter family of E'-paths establishes an i?-homotopy. This result explains why AL 
algebroids are objects of our primary interest rather than a smaller class of Lie algebroids 
or a more general class of skew-algebroids. Later we prove Lemma 13.151 which compares 
E'-homotopies with and without fixed end-points. Finally, the behaviour of i?-homotopy 
classes under reparametrisation (Lemma 13. 17p is studied. 



3.1 The ^-homotopy and its interpretation 

The definition of i?-homotopy will be given in two steps. First, we will describe the 
smooth case and later generalise the concept to measurable i?-paths, more suitable in 
control theory. The rest of this section is concerned with giving a convincing motivation 
and interpretation of the E'-homotopy. We give an interpretation in therms of a Stokes-like 
formula, and later show that E'-homotopies on an integrable algebroid A{Q) correspond 
to true homotopies in the groupoid Q integrating A{Q). The last interpretation will be 
crucial in Chapter H] to motivate the definition of an optimal control problem on an AL 
algebroid. 

Definition 3.1. Let ao,ai : / = [to7^i] — ^ E be two smooth admissible paths. An 
algebroid homotopy in E (or E-homotopy briefly) between and Oi is a pair of maps 
a,b : [toj^i] X [0,1] — > E, over the same base map x : [to7^i] x [0,1] — > M, with 
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ao(-) = a{-, 0) and ai(-) = a(-, 1), such that 

t a{t, s) is admissible for every s G [0, 1] , (3.1a) 
s (— )■ b{t, s) is admissible for every t G [to)^i]) (3.1b) 



dtb'{t, s) - dsa\t, s) = ck(x(t, s))b'{t, s)a''{t, s). (3.2) 



and, moreover, a and b satisfy a system of differential equations given in local coordinates 
{x"-, y^) in E by 

The i?-paths bQ{s) := b{tQ,s) and bi{s) := b{ti,s) will be called initial-point and final- 
point E-homotopies, respectively. We will say that E'-homotopy (a, b) has fixed end-points 
if bo = d^(to) and bi = 6'x.(ti). 

Having in mind that admissible paths are in a 1-1 correspondence with algebroid mor- 
phisms A : TR|/ — y E (an admissible path is the A-image of the canonical section {t, dt) 
of TR — compare Chapter [2]) , we may define E'-homotopy in an equivalent way. An E- 
homotopy between two smooth alegebroid morphisms Ao,Ai : TM|/ — > E (corresponding 
to i^^-paths Qq and ai) is an algebroid morphism 

H : TM|/ X TM|[o,i] — > E, 

such that Ao{-) = H{-,9o) and Ai{-) = H{-,9i), where Oq G TqM and 9i G TiR are null 
vectors. The equivalence with the previous definition can be seen as follows. The map H 
is determined by the images of two canonical sections {dt,6s) and {6t,ds). We can define 
a{t, s) := H{dt, 6s) and b{t, s) := H{6t, ds). Now conditions (12. 8p for H to be an algebroid 
morphism, translated to the language of a and b, are precisely (13. lap . (I3.1bp and (13. 2p . 
Note that this alternative formulation agrees with the notion of the homotopy of Lie 
algebroid morphisms as introduced by [Kubarski, 1994 . 



The notion of an E'-homotopy can be also extended to measurable setting. 

Definition 3.2. Consider two bounded measurable admissible paths Cq, Oi : [to, ti] — > E. 
An algebroid homotopy in E (or E-homotopy briefly) between Oq and ai is a pair of bounded 
measurable maps (w.r.t. both variables separately) a,b : [to;^i] x [0,1] — > E, over the 
same ACB base map x : [to^^i] x [0, 1] — > M, such that 

• O'o(') = O'i'jO) and ai(-) = a(-, 1) are well-defined trace values, 

• (13. lap and ( ]3.1bp hold in a measurable sense, 

• the pair (a, b) is a weak solution of (13. 2p with a well-defined trace (see Appendix 



R3]), that is 



/x[0,l] 
[0,1] 



b\t, s)dttlJi{t, s) - a\t, s)dsilJi{t, s) + ci^{x{t, s))b>{t, s)a\t, s)^lji{t, 



dtds 
dt 



b\0, s)^,(0, s) - b'{l, s)^IJi{l, s)J ds - y [a^(t, 0)ij^{t, 0) - a\t, l)V^,(t, 1) 

(3.3) 

holds for every family of functions ipi G C°°{I x [0, 1]; M). 
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Note that considering only W-solutions of (13. 2 p would not be enough, since otherwise 
the boundary paths ao(t), ai{t), 6o(s), and bi{s) would not be well defined. For more 
information on W- and WT-solutions see Appendix IB. 31 The notion of the initial-point 
and the final-point E-homotopy, as well as the E-homotopy with fixed end-points, also 
remains valid in this new setting. 

From now on, by an i?-homotopy we will mean a pair of maps (a, b) in the sense of 
Definition O 

Observe that any two measurable maps a,b : I x [0, 1] — y E over the same AC base 
map X : / X [0, 1] — > M define a measurable bundle map H : T]R|/ x TM|[o,i] — > E (that 
is, a measurable map linear on fibers), where H{dt, 6s) = a{t, s) and H{6t, ds) = b{t, s). 

Like in the case of i?-paths, also E'-homotopies allow a natural notion of composition. 
Let, namely, a,b : I x[0, 1] — > E over x, and a,b : Jx [0, 1] — > E over x (where / = [to, ti] 
and J = [ti,t2]) be two E'-homotopies. Assume that the final-point £^-homotopy of the 
first and the initial-point i?-homotopy of the second coincide; i.e., b(ti,s) = b{ti,s) a.e. 
(hence x(ti,s) = x(ti,s), so a{-,s) and a(-,s) are composable for every s G [0,1]). The 
maps a,b : I U J X [0,1] — > E defined as 



a(t, s) 

and 

b{t, s] 





for t < ti, 
for t > ti 

for t < ti, 
for t > ti 



clearly form an E'-homotopy joining a(-, 0) o a(-, 0) and a(-, 1) o a(-, 1). The initial-point 
ii^-homotopy is 6(to, ■), while the final-point iJ-homotopy is 6(t2, ■). 



Uniqueness of £'-homotopies 

As a direct consequence of the definition of an E'-homotopy and Lemma IB. 191 we get the 
following result. 

Lemma 3.3 (uniqueness of E'-homotopies) . Let a : / x [0, 1] — > E be a bounded mea- 
surable map covering x : / x [0, 1] — > M such that t i— )■ a(t, s) is admissible for every s. 
Then there exists at most one bounded measurable map 6 : / x [0, 1] — > E covering x such 
that (a, b) is an E-homotopy with a given initial-point E-homotopy b{to, s) = bo{s). 



The E'-homotopy via Stokes theorem 

We shall now give another, more geometrical, description of an i?-homotopy by means of 
a Stokes-like formula. First, we will introduce the notion of an integral of an E-k-foim, 
i.e., an element u G Sec{A'' E*) , over a bundle morphism $ : TA^ — y E. We define 
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where the last integral is the standard integration of the differential fc-form ^*ui on the 
manifold A^. Now, if A^ is a manifold with boundary dN, we define 



d<S>(N) JdN 

Observe that in case $ : TA^ — y TM is the tangent lift of a diffeomorphism ip : A^ — > M, 
the above definitions coincide with the standard concept of differential form integration. 

The morphism $ need not be differentiable. Since, given local coordinates N D V — ^ 

V' CR''3 on N, 

Jv Jv'cM." 

we shall require only that $ maps smooth sections of TA^ into bounded measurable sections 
of E. 

Now assume that $ : TM|/ x TR|[o,i] — > E over Lf : M|/ x ]R|[o,i] — > M is a bundle 
map defined by means of measurable maps a{t, s) and b{t, s) as in the definition of an 
£'-homotopy. Assume, moreover, that conditions fl3.1ap and (I3.1bp are satisfied. Take any 



E'-l-form a G Sec(-E*); in local coordinates, a ~ Now 

/ dEa= // dsa($(9t),<l>(9,))dtds = // dsa {a{t, s),b{t, s)) dtds 

JJlx[0,l] JJlx[0,l] 



/x[0,l] 



Having in mind that pf{x{t, s))a^ = dtx"'{t,s) and p°'{x{t, s))}^ = dsX°'{t,s), and defining 
5j(t, s) := ai{x(t, s)), we get 

/ dEce = {Vdtaj — a^dsOij — aidjf^a^b^) dtds. 

J<S> JJlxlO.l] 



Similarly, 



9* 



a = {ai{t,0)a'{t,0) -ai{t,l)a\t,l))dt 



(ai(0, s)b\0, s) - ai{l, s)a\l, s)) ds. 

[0,1] 



As we see, fl3.3p holds for all if and only if 



d^tt = / a, (3.4) 

$ Jd<!> 



which can be understood as a generalized Stokes formula. 



3.1. THE ^-HOMOTOPY AND ITS INTERPRETATION 



21 



Remark 3.4. In fact, (13. 3 p is more general than (13. 4 p since ctj being the pull-back of a via 
the map $ cannot be an arbitrary function of t and s. We can, however, easily overcome 
this drawback by using the graph of $ in TM]/ x TR|[o,i] x E and (TM]/ x TM|[o,i] x E)- 
1-forms instead of $ and ii^-l-forms. 

Remark 3.5. The condition (13. lap for a (and analogously (13.1bp for 6) can be expressed 
in the Stokes-like way as well. Consider, namely, the map $«(■) := $(-,6's) : TMl/ — )■ E. 
The admissibility of a reads as 

[ dEf= [ f 

for every / G C~(M) and s G [0, 1]. 



£'-homotopies on an integrable algebroid 

Now we show that admissible paths and algebroid homotopies on an integrable algebroid 
A{Q) are true paths and true homotopies on an integrating groupoid Q reduced to A{Q) 
by means of the reduction map (lA.lD . We are using the language of Lie groupoids, so the 
reader unfamiliar with this topic should consult Appendix lA.ll 

Theorem 3.6 (integration). Let A{Q) M be a Lie algebroid of a Lie groupoid Q . Fix 
Xq.Uq G M and an element Qq G a"^(yo) H /3~^(xo). 
There is a 1-1 correspondence between: 

• bounded measurable admissible paths a : [to7^i] — ^ -^{G) over an ACB path x : 
[to,ii] — M such that x(to) = Xq, and 

• ACB paths g : [to,ti] — y Qy^ such that g(to) = go and x{t) = P{g{t)). 

The correspondence is given by means of the reduction map flA.ll) .- i.e., a{t) = TZ{dtg{t)) = 
TRg^t)-^{dtg{t)). 

Similarly, there is a 1-1 correspondence between: 

• bounded measurable algebroid homotopies a, b : [to, ti] x [0, 1] — > A{Q) over an ACB 
map X : [to, ti] x [0, 1] — y M such that x{to, 0) = Xo, and 

• ACB homotopies h : [to,^i] x [0,1] — y Qy^ (i.e., h is ACB w.r.t. both variables) 
such that h{to, 0) = go and x{t, s) = /3{h{t, s)). 

Again, the correspondence is given by means of the reduction map (lA.ip .- i.e., a{t,s) = 
n{dth{t, s)) = TRhit,s)-^ {dthit, s)) and h{t, s) = 7^(9,/^(t, s)) = TRh(t,s)~^ (5,/i(t, s)). 

Proof. In the smooth case the result can be easily derived from Theorem lA.2l and Corollary 
IA.4I We know that (cf. considerations on page |87|) smooth admissible paths and smooth 
algebroid homotopies in A{Q) correspond to algebroid morphisms TM|[i(, — y A{S) and 
TR|[ty (j] X T]R|[o.i] — y A{Q). The underlying manifolds are simply connected, hence the 
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morphisms can be lifted to smooth maps g : [to7^i] — > Gyo and h : [to7^i] x [0, 1] — Gyo, 
which are unique up to the choice of the initial points (cf . Corollary IA.4P . 



In the measurable case, however, the argument needs a little more attention. We will 
work in local coordinates (z*) on Qy^, {x"') on M, and linear coordinates {x°',y^) on A{Q). 
We have induced coordinates {z^,z^) on TQyg and {x°',x^) on TM. 

For g G Qy^, TRg-^ maps TgQyg = TgG isomorphically into A{Q)i3[g). In coordinates, 
TRg-i '■ {z^, z^) {x"', y*) can be expressed as 

y' = F;{z)z^, 

where /3'^(z) and Fj{z) are smooth and Fj{z) is invertible. By f-{z) we will denote the 
inverse matrix of Fj{z). The structure functions of the algebroid A{Q) in these coordinates 
satisfy 



ptim)F;iz)z^ = ^j^z^ 



dl3%z) 
dz^ 



dZyyi dZfl 



z z 



since p is the reduced T/3, and the ^(^)-bracket is the reduced Lie bracket on Q. From 
the above we get 



dFUz) dF^ (z 



To prove the first part of the assertion, observe that, if g : [to,ti] — > Qyg is an 
ACB path over an ACB path x : [toj^i] — ^ M, then the derivative dtg(t) G T^g{t)Gyo is 
a bounded measurable path, and so is a(t) = TZ{dtg{t)) = TRg(^tj-i{dtg{t)), since TZ is 
smooth. Clearly, x{t) = Tl3{dtg(t)) = p{a(t)) (cf. diagram (lA.ip ). so a{t) is a bounded 
measurable ^(^)-path. 

Conversely, consider a bounded measurable admissible path a : [to,ii] — > A{Q) over 
an ACB path x : [to;^i] — > M. For every t G [to;^i] and all g satisfying P{g) = x{t) we 
may lift a{t) G A{Q)x{t) to a vector A{t,g) := TRg{a{t)) G TgGyo- We would like to define 
g{t) as a solution of the differential equation in Qy^^ 

dtg{t) = A{g,t) 

with the initial condition g{to) = go- Then, clearly, TRg(^t)-^{dtg{t)) = TRg(^t)-^A{g{t),t) = 
a{t) as in the assertion. The problem is that, since A{g,t) is defined only on a subset of 
Qyg it is not clear that the solution exists, nor that it is unique. To overcome this difficulty 
consider a differential equation on Qy^ given in local coordinates by 

z^ = fUz)a^{t). (3.5) 
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It satisfies the assumptions of Tlieorem IB. 121 for measurable ODEs, so it has an ACB 
solution z{t), unique up to the choice of the initial point. In particular, let z{t) be the 
solution with z{tQ) = Qq ^ Qy^. The base trajectory x{t) = I3{z{t)) satisfies 

x{to) = l3{z{to)) = l3{go) = Xq. 

On the other hand, by admissibility of a{t), we have dtX°'{t) = p'}{x{t))a'^{t) and x(to) = Xq, 
hence; clearly, x{t) = x{t). This, in turn, implies that z^{t) = fj{t)a^{t) = A^{z{t),t), i.e., 
g{t) = z{t) as above is well defined and unique. 

Now consider a homotopy h : [to, ti] x [0, 1] =: K — y Qy^ over x : [to, ti\ x [0, 1] — > M, 
which is ACB w.r.t. both variables. In local coordinates it is given by z'^{s,t). Repeat- 
ing the argument from the previous part, we can prove that the maps t a{t,s) := 
T^Rh{t,s)-'^ idth{t,s)) and s (—)■ b{t,s) := TRh(^t,s)-^{dsh{t, s)) are bounded measurable ad- 
missible paths over t i— )■ x(t, s) and s ^ x{t, s), respectively. In local coordinates, 

a'{t,s) = F;{z{t,s))A^{t,s), 
V{t,s) = F;{z{t,s))B^it,s), 

where we denoted s) := dtZ^{t, s) and -B*(t, s) = dsz\t, s). 
Since /i is a homotopy, we have 

jj z'{t,s)dtd,(j)i{t,s)dtds = jj z\t,s)dsdt(t)i{t,s)dtds, 

for every (pi £ C°°{K). Integrating the above equality several times by parts, we get that 
A^{t, s) and -B*(t, s) satisfy the differential equation 

dsA\t,s)^= dtB\t,s). 
Now calculating the WT-derivatives of a*(t, s) and s) we get 

dth\t, s) - dsa\t, s) =^ dt {F;{z{t, s))B^{t, s)) - ds {F;{zit, s))A^{t, s)) 

s)) - ^{z{t, s))) B-{t, s)A"^{t, s) 

+F;{z{t, s)) {dtB^it, s) - dsA^it, s)) 
= c],{P{z{t, s)))Vit, s)a''it, s) + = c;.,(x(t, s))Vit, s)a'^{t, s). 

We see that (a, b) is an ^(^)-homotopy. 

Conversely, let a,b : [to,ti] x [0,1] — > A{Q) over x : [to,^i] x [0,1] — > M be an 
algebroid homotopy. By the first part of the assertion we can uniquely integrate the 
admissible path s H- 6o(to, s) to an ACB path (7o(s) G Qy^ with go{Q) = Qq. Next we can 
uniquely integrate each admissible path t H- a(t, s) to an ACB path g{t, s) G Qy^ such that 
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g(to,s) = go{s)- In local coordinates g{t,s) is a solution of the differential equation (cf. 
the previous part of this proof) 

dtz\t,s) = f;{z{t,s))a^{t,s), 

where zo{s) = Qois) is ACB. By Theorem IB.13| g(t,s) is ACB w.r.t. both variables. 
Now g(t,s) is an ACB homotopy in Qy^^ hence, as has already been proved, it reduces 
to an algebroid homotopy a,b : [toj^^i] — > By construction, a{t,s) = a{t,s) and 

b{tQ,s) = b{tQ,s). We see that (a, 6) and (a, 6) are two WT-solutions of (13 ■2p with the 
same initial-point ^(^)-homotopy b{tQ, s). By Lemma [3.31 s) = b{t, s). □ 



Remark 3.7. The above theorem is closely related to the ideas of [Crainic &: Fernandes, 2003 



The correspondence between algebroid homotopies and homotopies in an integrating 
groupoid may be used to address the question about integrability of Lie algebroids (see 
remark on page [SB]) . 

In fact, we can also use it to prove Theorem I A. 21 of Mackenzie and Xu. To sketch the 
idea, let us concentrate on the case when H = S x S is a, pair groupoid, with S simply 
connected. Consider a morphism of Lie algebroids $ : TS* — > ^{Q) over / : 5* — > M. 
Fixing points Xq G S and g^ G Q f(^xo)f^P~^{f{xo)), we can attach to each sufficiently regular 
curve 7 : [0, 1] — )■ S, originated at 7(0) = Xq, a curve g : [0, 1] — > Qf(xo)y with g{0) = g^, 
being the lift of an admissible curve $(7(-)) : [0, 1] — > A{Q). Now, if 70 and 71 are two 
curves such that 7o(0) = 7i(0) = Xq and 7o(l) = 7i(l), then, since S is simply connected, 
there exists a homotopy 7(t, s) in S (with fixed end-points) joining 7(-,0) = 7o(-) and 
7(.,1) = 7-^(.). The lift of the ^(^)-homotopy (<l>(9j7(t, s)), $(9,7(t, s))) is a homotopy 
g{t,s) in Qf{xo) (with fixed end-points) joining the lifts of 7o(-) and 7i(-). Consequently, 
the map $ : 7(1) 1— )■ g{l), S — > Qf{xo) is well defined. One can prove that TZ o T$ = $. 
The presence of such a map is equivalent to the integrability of $ (see Corollary IA.4p . A 
similar argument can be used to prove Theorem IA.2I in full generality. 

Corollary 3.8. Theorem \3.b\ establishes the equivalence between A{Q) -paths /homotopies 
and standard paths/homotopies in a single a-fibre in the groupoid Q. For the groupoid 
Qp = P X P/G and the associated Atiyah algebroid TP/G, these fibres are canonically 
isomorphic to P, so the E -homotopies are just standard homotopies in P reduced to TP/G. 
The two are equivalent up to the choice of the initial point. 



£'-homotopy classes 

Definition 3.9. Two measurable E-paths ao,ai : [toj^i] — ^ E are E-homotopic iff there 
exists an i?-homotopy (a, 6) with fixed end-points (i.e., b{tQ, ■) = = b{ti, ■)) between oq 
and ai. Being i?-homotopic is an equivalence relation. 

An equivalence class of an element a will be denoted by [a] (or sometimes [o(i)]te[t(),ti]) 
and called an E-homotopy class. 



3.1. THE ^-HOMOTOPY AND ITS INTERPRETATION 



25 



So far, the above definition does not allow us to compare the i?-homotopy classes of E- 
paths defined on different time intervals. Therefore, we will add a natural condition that a 
composition with a null path not change the equivalence class: [ao6x{ti)] = [o] = [^a;(io) °'^]- 

Observe that, since two i?-homotopies with fixed end-points are composable (iff the 
final base point of the first coincides with the inital base point of the second), the com- 
position of i?-homotopies defines a multiplication of i?-homotopy classes by a natural 
formula 

[a] ■ \a] := [a o a] when a and a are composable. 

Consider now an algebroid E and two smooth algebroid morphisms $o : T5'o — > E 
and $1 : TS*! — > E over (pQ : Sq — > M and (pi : 5*1 — > M, respectively. 

Definition 3.10. We say that measurable E'-paths and ai are E-homotopic relative 
to the morphisms $o (md $i iff there exists an i?-homotopy {a,b) between oq and ai, 
and AC paths z : [0,1] — 5*0 and w : [0,1] — )■ 5*1, such that b(tQ,s) = ^o{dsZ{s)) and 
b{ti,s) = ^i{dsw{s)). In other words, initial-point and final-point E'-homotopies lie in 
Im$o and Im$i, respectively. Note that b{tQ,-) and b{ti,-) are admissible as images of 
admissible paths under an algebroid morphism. 

The relation of being relatively i?-homotopic is again an equivalence relation and we 
may again speak of the equivalence classes {relative E-homotopy classes). A class of an 
element a will be denoted by [a] mod(<l>07 "^^i)- 

Remark 3.11. i?-paths ao and ai are E'-homotopic iff they are iJ-homotopic relative to a 
morphism 1^^, which maps 5*0 = {pt} ~ TSq to a null vector O^g, where Xq = t o ao{to) = 
T o ai(to), and a morphism l^.^ defined analogously for Xi = r o ao(ti) = t o ai{ti). 

The interpretation of E'-homotopy classes 

Tn light of Theorem 13. 6 j an interpretation of the notion of E'-homotopy classes is clear. If 
E = A{Q) is an integrable Lie algebroid and (a, 6) : [toj^i] x [0, 1] — ?• E is an algebroid 
homotopy with fixed end points, we can lift it to the true homotopy g{t, s) in a single a- 
fibre Qy^ of Q. The i?-paths a(-, 0) and a(-, 1) correspond to g{-, 0) and g{-, 1), respectively, 
and null paths b{to,-) and b{ti,-) to constant paths g{to,-) and g{ti,-), respectively. In 
other words, g{t, s) is a homotopy in Qy^^ between g{-, 0) and g{-, 1) with fixed end-points. 
Consequently, we can interpret i?-homotopy classes as reduced homotopy classes from an 
a-fibre Qy^^ of a Lie groupoid Q to the associated Lie algebroid E = A{Q). In particular, if 

is a gauge groupoid of a principal G-bundle G ^ P M, all a-fibres are isomorphic 
to P (cf. Appendix lA.ip . hence algebroid homotopy classes in the Atyiah algebroid TP/G 
are the standard homotopy classes in P reduced to TP/ G by the G-action. 

For relative E'-homotopy classes things are a little more complicated. Assume that 
E = A{Q) is an integrable Lie algebroid and a, b : [tg, ^i] x [0, 1] — > A{Q) is an algebroid 
homotopy relative to ($0)'^'i)- Let z{-) C 5*0 and w{-) C 5*1 be as in the Definition 
13.101 Assume, in addition, that $o and $i are integrable. By Theorem 13.61 we can lift 
(a, 6) to the homotopy g{t,s) G Qy^^ C Q. By Corollarv IA.4I we can lift $o fo a smooth 
map $0 • Sq — y Qyg such that ^q{z{0)) = g(tQ,0), and we can lift $i to a smooth map 
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$1 : Si — y such that $i(w(0)) = g{ti,0). Paths $o(^(')) dito,-) correspond to 
the same ^(^)-path b{tQ, ■) and have the same initial point, hence are equal. Similarly, 
$i(u'(-)) = g{ti, ■). In other words, g{t, s) is a homotopy in Qy^ joining g{-, 0) and g{-, 1) 
with end-points in the images of $o and $i. 

To sum up, (a, b) is a reduction of a homotopy in Qy^ with end-points contained in the 
images of $o and $i integrating $o and $i. 

Note that algebroid morphisms $o and $i need not to be integrable. In such a case 
the interpretation given above is still valid, but locally. Let namely Uq C 5*0 be an open 
simply connected neighbourhood of z{0) and let Ui C 5*1 be an open simply connected 
neighbourhood of w{0). Now, by Corollary \AA\ we can lift $o|(7o • Tf/o — > -^{S) and 
$i|(7i : Tf/o — > -^{G) to $o|f/o : f/o — > Qya and <I>i|c/i : Ui — > Qy^, respectively. 
Hence, if b{tQ, ■) C Im$o|i/o and b{ti, ■) C Im$i|{/^ we can still interpret the relative A{Q)- 
homotopy (a, b) as the homotopy in Qy^ with end-points in the images of $o|i/o 'J'i|c/i, 
reduced to the algebroid A{Q). 

Another, more universal approach is the following. Consider the universal covers ttq : 
^S'o,2(0)j — > {So,z{0)) and tti : ^5*1, ■£'(0)^ — > (5*1,^(0)). Now take Lie algebroid 

morphisms $^ := o vTj : TSi — > -^.{0), for i = 0,1. They are clearly integrable 
to : S^ ^ Gy^, since 5*0 and 5*1 are simply connected. As b{to,-) C Im$Q and 
b{ti, ■) C Im$^, we can interpret (a, fe) as a reduced homotopy in Qy^ with end-points in 
the images of $q and 

In particular, if ^ = (yp is a gauge groupoid of a principal G-bundle G ^ P ^ M, 
then Qy^ ^ P. Relative TP/G-homotopies are homotopies in P with end-points in the 
images of maps $q : 5*0 — > P and : 5*1 — > P, reduced by the G-action. 

3.2 Fundamental properties of ^-homotopies 
E'-homotopies as families of £'-paths 

The following lemma emphasis the role of AL algebroids. Roughly speaking, it turns out 
that for AL algebroids one-parameter families of E'-paths are E'-homotopies. 

Lemma 3.12 (generating E'-homotopies) . Let E be an AL algebroid, and let a : I x 
[0, 1] — y E be a one-parameter family of bounded measurable E-paths (that is, t t— )■ a{t, s) 
is admissible for every s ) covering x : / x [0, 1] — > M. Assume that a{t, s) is ACB w.r.t. 
s; that is, dsa(t,s) is defined a.e. and is bounded measurable w.r.t. both variables. Let 
bo{s) be an arbitrary bounded measurable E-path covering x(to, s). 

Then there exists an unique E -homotopy a,b : /x [0, 1] — > E such that b{to, s) = bo{s). 
Moreover, b{t, s) is ACB w.r.t. t (that is, dtb{t, s) is defined a.e. and is bounded measurable 
w.r.t. both variables). 

Proof. By the definition of an £'-homotopy, b{t, s) should be a map covering x{t, s) such 
that s I— >■ 6(t, s) is admissible and fl3.3p is WT-satisfied. Observe that, since dsa(t, s) is 
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well defined a.e., the system of equations 

dtb'{t, s) = dsa%t, s) + 4^(x(t, s))¥{t, s)a''{t, s) (3.6) 

for b(t, s) satisfies the assumptions of Theorem IB. 131 Consequently, it has a unique 
Caratheodory solution b^{t,s) for a given initial condition b^{to,s) = bQ{s). The solu- 
tion b{t, s) is ACB w.r.t. t and, since the parameter-s-dependence of both right-hand side 
of (13. 6p and the initial condition is bounded measurable, so is the s-dependence of the 
solution b{t,s). Consequently, the right-hand side of (13.61) is bounded and measurable 
w.r.t. both t and s, and hence so is dtb{t, s) — the left-hand side of (13. 6p . Clearly, a and b 
are regular enough to satisfy the assumptions of Theorem IB.18| so the integral condition 
(I33|) holds. 

To prove that thus constructed (a, b) is indeed an E'-homotopy, it is enough to show 
that s I— >■ b{t, s) is admissible for every fixed t. Consider a map 

X''{t,s) ■.= d,x''{t,s)-pt{x{t,s))¥{t,s). 

We shall show that = a.e. Observe that, since a{t, s) is a family of admissible paths, 
we have 

dtx^it, s) = pI (x(t, s)) a\t, s) a.e. (3.7) 

The right-hand side of this equation is differentiable with respect to s, and hence so is the 
left-hand side, and 

dsdtx^it, s) = ^ (x(t, s)) d,x\t, s)a\t, s) + pl (x(t, s)) d,a\t, s). 
Consequently, as dtdsX"'{t, s) ^ dsdtx°'{t, s) (since x{t, s) is a true homotopy in M), 

dtX^ = dtdsX''-dt{plb^)'^= dsdtX'^-dtiptb'') 

= -^.dsx'a" + pld^a^ - -^.dtx'U - p^dtU , 
which, in view of (13. 7p and (13. 6p . equals 

^.dsx'a^ + pld.a' - ^.Pla'b^ - pt {d.a' + c),Va') = 
d_ 

dx^ 



:Pl ) + 



Since E is an AL algebroid, the last term vanishes and we have 

Thus is a WT-solution of a linear differential equation with measurable r.h.s. and the 
initial condition x°'{^OiS) = (since bQ{s) is admissible). Repeating the argument from 
the proof of Lemma [B. 191 we conclude that X° = ^i.e. □ 

It turned out that, when a skew-algebroid is almost Lie, E'-homotopies are the true 
homotopies in the space of i?-paths (i.e. one-parameter families of E'-paths). This has 
already been observed in [Grabowska fc Grabowski, 2008 Thm. 3] in a slightly different 
form. 
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Relation between £'-homotopies with and without fixed 
end-points, reparametrisation 

Lemma 3.13. Let a : [to,ti] — y E be a bounded measurable E-path over x{t), and let 
h : [0, 1] — [to;^i] be an invertible C^-function. Define 

a{t,s) :=M£l^, (to + ^{h{s)-t^ 

^ ^ (3.8) 

b{t, s) := ^^h{s)a (to + ^^{h{s) -to)]. 

ti — to \ ti — to J 

Then the pair (a, 6) is an E-homotopy over x(t, s) := x (to + TT^i^i^) ~ ^o) j ■ 
Proof. For notation simplicity assume that [tc^i] = [0, !]• Then 

a{t,s) = h{s)a{th{s)) and 
b{t, s) = th{s)a{th{s)). 

First, note that t h-> a{t, s) and s h-> b{t, s) are admissible. Indeed, from x{t) = p {a{t)) we 
deduce that 

dtx{t, s) = h{s)x{th{s)) = h{s)p {a{th{s))) = p {a{t, s)) . 
Similarly, dsx{t, s) = p {b{t, s)). Now we will check that 

dt[th{s)a'{th{s))] = ds[h{s)a'{th{s))] + cii^{x{t, s))[th{s)a^ {th{s))] ■ [h{s)sa''{th{s))]. 
By the skew-symmetry of c*;., the last term vanishes, so we have to check if 

dt[th{s)a'{th{s))] = ds[h{s)a'{th{s))]. 

The latter is certainly true, as both sides are equal h{s)a^(th{s)) + th{s)h{s)A'^(th{s)), 
where is the distributive derivative of a*(t). 

To finish the proof we shall show that a{t, s) and b{t, s) satisfy the regularity conditions 
flRTOj) and f iRTT]) . 

Assume that h{0) = to = and h{l) = ti = 1 (the case h{l) = to = and h{0) = ti = 1 
is completely analogous). Now 

[ \a{t,s) - a{t,0)\-dsdt = - [ f \h{s)a{th{s))\dtds <- f h{.s)\\a\\ds. 
Jo ^ ^ Jo Jo ^ Jo 

The later converges to as e — )■ 0, since h{s) — )■ h{0) = 0. Next, 

[ \a{t,s)-a{t,l)\-dsdt = - [ [ \h{s)a{th{s)) - h{l)a{th{l))\dtds 

Jl~e ^ ^ Jl~£ Jo 

<- [ h{s) [ \a{th{s)) -a{th{l))\dtds + - [ \h{s)-h{l)\ [ \a{th{s))\dtds. 

£ Jl-e Jo ^ Jl-£ Jo 
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The second factor converges to as e — because h{s) is continuous at s = 1 and a is 
bounded. By Lemma lB.41 the measurable function g(s) := \a{th{s)) — a{th(l))\dt is 
regular at s = and, moreover, g{s) = 0. We conclude that 



1 

- / h{s)g{s)ds as e -> 0. 

^ Jl-e 



Consequently, J^_^ |a(t, s) — a{t, l)\^dsdt and conditions (IB.lOp are fulfilled. 
Now check (IB.11|) . The first of the two conditions is a matter of a simple estimation: 

[ [ \b{t,s) -b{0,s)\-dtds = - [ [ \th{s)a{th{s))\dsdt < - [ ■ ||a||dt ^ 0. 
Jo Jo e e Jo Jq e Jq 

For the second we can estimate: 

f \b{t,s) -b{l,s)\-dtds = - [ [ \th{s)a{th{s)) - h{s)a{h{s))\dsdt 

Jl~e ^ ^ Jl-e Jo 

<- [ t\\h\\ [ \a{th{s)) - a{h{s))\dsdt + - [ \l-t\-\\h\\ [ \a{h{s))\dsdt. 



l-e JO ^ Jl~e 



The last factor clearly converges to as e — )■ 0. Using Lemma IB. 41 we show that the 
measurable function k{t) := \a{th{s)) — a{h{s))\ds is regular at t = 1 and, moreover. 



k(l) = 0. We conclude that 

1 



e 



1 

t\\h\\k{t)dt ^ 0, 

l-e 



which proves that conditions (IB.lip are satisfied. By Theorem IB. 181 the pair (a, b) is a 
WT-solution of (13. 2p . and hence E'-homotopy. □ 

As a corollary we obtain the following fact. 

Lemma 3.14 (shrinking an E'-path). Let a : [0,1] — > E be a measurable E-path over 
x{t). Define a{t,s) := sa{ts) and b{t,s) := ta{ts) fort,s G [0,1]. The pair {a,b) is an 
E-homotopy over x{t, s) = x{ts). Its initial-point E-homotopy is 6*^.(0), and the final-point 
E-homotopy is a. 

Similarly, consider a(t, s) := (1 — s)a(l — (1 — t)(l — s)) andb{t,s) := (1— t)a(l — (1 — 
t){l — s)) where t, s G [0, 1]. The pair (a, b) is an E-homotopy over x{t, s) := x{l — (1 — 
t){l — s)). Its initial-point E-homotopy is a, and the final-point E-homotopy is 6x{i)- 

Proof. The assertion follows from Lemma fS.lSl For (a, b) we simply take a(t) and h{s) = s. 
For (a, 6) we use Lemma [3. 131 with a{t) := a(l — t) defined on an interval [to = l,ti = 0] 
and h{s) = s. □ 

We can now state the following important result. 
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Lemma 3.15. Let a,b : [to,^i] x [0,1] — > E be an E-homotopy covering x : [toj^i] x 
[0, 1] — > M. Then we have the following equality of E-homotopy classes: 

Ht, O)]te[to,ti] [^(^1, s)]se[o,i] = [^(^0, s)]se[o,i] l)]te[toM- 

Proof. The first part of Lemma I3.14[ applied to tlie curve s ^ b(to,s), gives us the 
existence of i?-homotopy c, d : [0, 1] x [0, 1] — > E such that c{t, 0) = 9x(^to): 1) = b(tQ, s), 
d{0,s) = 9x{tQ), and d{l,s) = b{to,s). Similarly, using the second part of Lemma 13.141 for 
s ^-)■ b{ti, s), we obtain _E-homotopy e, / : [0, 1] x [0, 1] — )■ E such that e(s,0) = s), 
e(t, 1) = 6*^.(4,), /(O, s) = b{ti, s), and /(I, s) = 6*^(4,). 

Clearly, ii^-homotopies (c, d), (a, b), and (e, /) are composable and their composition is 
an i?-homotopy with fixed end-points which establishes an equivalence of E'-paths Ox^to) ° 
a(-, 0) o b{ti, ■) and b{to, ■) o a(-, 1) o e^^t^)■ □ 

Remark 3.16. The above lemma is very important, as it shows the relation between E- 
homotopies with and without fixed end-points. If a, 6 : / x [0, 1] — > E is an E'-homotopy 
joining and ai, then the composition of Oq with the final-point E'-homotopy b{ti, ■) is 
equivalent to the composition of the initial-point i?-homotopy 6(to, ■) with ai. Thus, if 
the initial-point i?-homotopy b{tQ,-) vanishes, in order to check whether [oq] = [oi], it is 
enough to check whether [b{ti, ■)] = 0. Thus the problem of equivalence of ao and ai can be 
solved by investigating the final-point E'-homotopy. Similarly, we can address the problem 
of relative E'-homotopy equivalence [oq] = [cti] mod($o; '^'i) by studying the classes [b{to, ■)] 
and [b{ti, ■)]. 

Finally, as a corollary from Lemmas 13.131 and 13.151 we obtain a result about reparametri- 
sation of £'-paths. 

Lemma 3.17 (reparametrization) . Let a : [to,ti] — > E be a measurable E-path, and let 
h : [0,1] — 7- [to,^i] be an invertible C^-function. Define a{t) := h{t)a{h{t)) fort G [0,1]. 
Then 

[a{t)]te[o,i] = [a{t)]te[to,h] if h{0) = to and h{l) = ti, (3.9) 
Ht)\te[t,M] ■ [«(^)]te[o,i] = z/ /i(0) = ti and h{l) = to- (3.10) 

Proof. Consider a homotopy ( 13. 8 p from Lemma (3.131 If /i(0) = to and h{l) = ti we have 
a{t, 0) = 0, a(t,l)=a(t), b(tQ, s) = 0, and b(ti, s) = h{s)a{h{s)) = a(s). By Lemma 13. 15[ 

[(^x(to)] ■ [«(s)]s6[0,i] = [(^x{to)] ■ [a{t)]telto,ti]- 

Analogously, for h{0) = ti and h{l) = to we have a(t, 0) = a(t), a(t,l)=0, 6(to, s) = 0, 
and b{ti, s) = h{s)a{h{s)) = a{s). From Lemma [3.151 we deduce that 

[«W]te[to,ii] ■ ["(■5)]se[o,i] = [Ox{to)] ■ [0x{to)] = 0. 

□ 



Chapter 4 



Optimal control problems on AL 
algebroids 



In this chapter we introduce the notion of a control system and an optimal control problem 
on algebroids. Much attention is payed to motivate these definitions. We show that equiv- 
ariant control systems and optimal control problems on a Lie groupoid Q lead naturally 
to system and problems on the associated Lie algebroid A{Q). What is more, our defi- 
nitions coincide with the standard ones for special cases of tangent algebroid and Atiyah 
algebroid. At the end, we define the natural notion of algebroid homotopy associated with 
a control system. 

From this chapter on, our attention is restricted to AL algebroids only. This choice is 
justified by the properties of algebroid homotopies on AL algebroids discussed in Lemma 

Control systems on AL algebroids 

Definition 4.1. A control system on an AL algebroid is a continuous map 



f:MxU — yE (4.1) 

such that, for every u & U, the map f{-,u) : M — > E is a C^-section of E. We will 
assume that f/ is a subset of some Euclidean space W . Moreover, we demand that the 
maps f : M X U — > E and T^f '■ TM x U — > TE are continuous. In local coordinates, 
if / ~ {f^{x,u),x°'), this means that f^{x,u) is continuous w.r.t. x and u, differentiable 
w.r.t. X, and that ^{x,u) is continuous w.r.t. x and u. 

Observe that, for the tangent algebroid E = TM — M, the above definition coincides 
with the classical one (cf. Definition IC.ll in Appendix O . On the other hand, one easily 
sees (cf. Theorem 13. 6p that a right-invariant control system on a Lie groupoid Q reduces 
to a system of the above form on the associated Lie algebroid A{Q). For example, a 
right-invariant control system on a gauge groupoid Qp = P x P/G of a principal bundle 
G — )■ P — )■ M is determined by its values on a single leaf of Qp canonically isomorphic to 
P. Consequently, it is equivalent to a G-invariant control system on P and reduces to a 
control system of the form (14. ip on the Atiyah algebroid E = TP/G. In particular, for a 
right-invariant system on a Lie group G, Definition 14. 11 coincides with the reduced control 
system on its Lie algebra g as described in Jurdjevic, 1997 Ch. 12]. 
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Now, for a given function u : I — > U (control), the map (14. ip defines a first-order 
ODE on M, 

x(t) = p(/(x(t),w(t))). (4.2) 

We will restrict our attention only to functions m of a certain class (called admissible 
controls). In this paper these are controls which are bounded and measurable, but one 
can think of smaller classes: piecewise continuous or piecewise constant functions. The 
set of all admissible controls will be denoted by Uadm- 

Clearly, if u(-) is admissible, the map g{x,t) = p{f{x,u{t))) is different iable w.r.t. x 
and measurable w.r.t. t, so the assumptions of Theorem IB. 121 hold. Consequently, we 
have the results of local existence and uniqueness for the solutions of (14. 2p . Observe that 
if x(-) is a solution of (14. 2 p for u{-) G Wadm, then the path /(x(-),m(-)) : / — > E is a 
measurable E-path over x(-). This path will be called a trajectory of (14. 2p . whereas for 
the pair (x(-),m(-)) we will use the term controlled pair. 

Observe that if = TM is a tangent algebroid, then the trajectory of the system (14. 2 p 
is the tangent lift of the trajectory of a corresponding system (IC.ip on M. The notions of 
controlled pairs coincide in both cases. 



Optimal control problems on AL algebroids 

We introduce now a cost function L : M x U — > M. We will assume the same regularity 
conditions for L as in the case of /, namely, that L is a continuous function on M x ?7, 
which is of class w.r.t. the first variable and that the derivative d^L : TM x U — > M is 
continuous. If now {x{t),u{t)), with t G /, is a controlled pair for (14. 2p . we define the total 
cost of this pair to be J^^ L(^x{t),u{t)^dt. Note that, since L is continuous, u{t) is bounded 
measurable, and the interval [to;^i] is compact, the above integral is finite whenever the 
solution x{t) exists. Now we can define optimal control problems for the data introduced 
above. These definitions may seem unnatural at first sight, yet we will motivate them in 
the next subsection. 

Definition 4.2. For a control system (14. ip and a cost function L we define an optimal 
control problem (OCP) as follows: 

rti 

mmimise / L{x{t),u{t))dt over all controlled pairs (x, u) of (14. 2 p such that 



to 



the i?-homotopy class of the trajectory f{x{t),u{t)) equals [a] 



where a is a fixed E-path. The interval [to;^i] is to be determined as well. 

Given two smooth algebroid morphisms $o • TS'o E and $i : T^i E, we can also 
define an optimal control problem relative to ($0) "^i) as follows: 

rti 

minimise / L{x{t),u{t))dt over all controlled pairs (x, u) of (14. 2 p such that 
the relative .E-homotopy class of f{x{t),u{t)) equals [a] mod($0) '^'i); 
where a and [to^^i] are as above. 
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Interpretation of the algebroid OCPs 



Now we shall relate the OCPs ([P]) and (IP rel|) to the standard OCPs considered in control 
theory. Briefly speaking, the i?-homotopy restrictions in the OCPs on AL algebroids play 
a role of boundary condition in standard problems. 

Let us concentrate flrst on ([P]). Recall from Chapter [3] that, for an integrable algebroid 
vA(^), we have interpreted ^(^)-homotopy classes as the standard homotopy classes re- 
duced from a single a-flbre Qy^ of an integrating groupoid Q to the associated algebroid 
A{Q). Moreover, at the beginning of this chapter we have interpreted control system (14. ip 
on an integrable algebroid E = A{Q) as a reduction of a right-invariant control system on 
the groupoid Q (or on a single a-flbre Qyg). Consider now a control system on a manifold 

J^: N xU — ^ TA^, (4.3) 



with the cost function C : N x U 
N: 



i, and let us compare the following two OCPs on 



minimise over all controlled pairs {x, u) 

J to 

satisfying xito) = Xq, x{ti) = Xi, 



:pi) 



and 



rti 

minimise over all controlled pairs [x, 

J to 



U 



for which the homotopy class of x{t) equals [a], 

where a is a flxed path in joining Xq and Xi and the time interval [to, ^i] is not determined. 

Problem (P_i) is a standard OCP on the manifold A^. On the other hand, 
equivalent to the OCP ([P]) on a tangent algebroid TA^. 



1^ is 



We may also think of A^ as of an a-flbre Qy^^ of a groupoid Q with the control system 
(14. 3 p and the cost C being ^-equivariant, and such that they reduce to the control system 
(14. ip and the cost function L : U x M — y M on the associated algebroid E = A{Q). 
Clearly, in this situation, problem ([P]) on E = A{Q) is equivalent to problem ( IP2P on A^. 



Now let us compare problems ( |PiP and (jP^)- First, note that every solution of ( |PiP 
gives a solution of (IP2D for some [a] G Ili{N,Xo,Xi). On the other hand, if we know the 
solutions of (P2) for all possible classes [a] G IIi{N,Xq,Xi) then one (or more) of these 
solutions which has a minimal total cost is a solution of (\Pi\) . To sum up, problem ( IP2P 



is more reflned than ( |PiP . 

Observe that candidates for the solutions of (ED are usually indicated by the PMP. In 
the proof one compares the optimal trajectory with nearby (and hence homotopic) ones. 
Consequently, the PMP gives only conditions for local optimality and as such will also 



indicate all candidates for the solutions of (P2) for all possible classes [a] G ni(A^, xo,Xi 



(if such candidates exist). Then, to solve (Pj^) or (P2), one has to investigate closer these 
candidates to check whether they are really optimal. 
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Finally, note that problems ( |PiD and ( IP2D are equivalent if is simply connected. In 
fact, we can always lift the control system T : N x U — > TN and the const function 
C: N xU — >Rto ^ : N xU — ^TiVand£:iVxt/ — >R defined on the universal 
cover N of N. 

The discussion for the OCP flP rel|) is quite similar. In the same setting as before 
consider two smooth maps $0 : •S'o — > N and $1 : Si — > N. Now compare the following 
two OCPs on A^: 



mmimise over all controlled pairs (x, u) 

J to 

satisfying x{to) G Im$o! x{ti) G Im<I>i, 



and 



(P3) 



minimise / C(x(t),u(t))dt over all controlled pairs (x,u) for which 

the homotopy class of x{t) equals [a] relatively to the images Im$o and Im<l>i. 

Here a is a fixed path in A^, and we say that two paths (Tq and ai are homotopic relatively 
to the images Im$o and Im$i if there exists a homotopy joining ctq and cxi with the 
end-points in Im$o and Im$i. As before the time interval [to;^i] is not fixed. 

Problem ( IP3D has a form of the standard OCP on the manifold A^ (one usually assumes 
that $0 and $1 are immersions). Problem ( IP4D , in turn, is equivalent to the OCP (IP rell) 
for a control system on the tangent algebroid TA^ for algebroid morphisms $0 = T$o '■ 
TSo — > TN and $1 = T$i : T^i — > TN. 

Analogously as before, we can also think of A^ as of an a-fibre Qy^ of a groupoid Q, 
with the control system (14.31) and the cost function being ^-equivariant and reducing 
to (14. 2 p and L. If now $0 and $1 are algebroid morphisms $0 : TS'o — > A{Q) and 
$1 : T^i — > A{g) lifted to Gy^ = N (cf. Corollary IQ) , then 1^ on A^ is equivalent to 
(IFTdD onE = AiG). 

Relation between ( IP3D and (P4) is analogous to the relation of (|Pi[ ) and ( IP2D : 



Every solution of ( IP3D is a solution of (IP4D for some class [a] mod($0; '^'i)- 



The solution of (IP3D is this solution of (IP4D which has a minimal total cost of all 
solutions of (IP4D for all possible classes [a] mod($07 '^'i)- 



The solutions of (IP3D and ( IP4D are not distinguishable by the PMP. 



Problems ( IP3D and (\P4\j are equivalent if A^ is simply connected. This fact may not be 
obvious at first. It can be deduced from the following lemma. 

Lemma 4.3. Let N be a simply connected manifold, and let Sq, Si G N be two path- 
connected subsets. Choose paths a"o,ai : [0,1] — > N such that (To(0), cri(O) G 5*0 and 
(To(l), cTi(l) G 5*1. Then there exists a homotopy in N joining ctq with ai which has its 
end-points in So and Si. 
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Proof. By path-connectedness of 5*0 and 5*1, there exists a path bo : [0, 1] — > So joining 
(To(0) and o"i(0), and a path bi : [0, 1] — > Si joining cro(l) and cri(l). Denote by bo(t) := 
feo(l — t) and bi(t) := — t) the inverse paths of bo and bi. 

Now path (To ^-iid the composition bo * ai * bi are homotopic with fixed-end-points 
in N, since they have the same end-points and is simply connected (by * we denote 
the concatenation of paths). Let H : [0, 1] x [0, 1] — > N be the appropriate homotopy. 
Consider homotopies Ho : [0, 1] x [0, 1] — > So and Hi, [0, 1] x [0, 1] — > Si defined by the 
formulae Ho{t, s) := &o((l ~ t)s) and Hi{t, s) = bi(ts). It is straightforward to verify that 
the composition of homotopies H := Ho* H * Hi makes sense, and it is a homotopy joining 
^0 '■= C(To(o) * (Jo * Co-o(i) with ai := bo * bo * ci * bi * bi (here stands for a constant path 
equal x G A^). Moreover, the initial-point homotopy of H is Ho{0,s) = bo{s) G So and 
the final-point homotopy is i?i(l, s) = bi{s) G 5*1, i.e., the paths ag and ai are homotopic 
relative to So and 5*1. 

To finish the proof observe that ao is homotopic (with fixed end-points) to ctq and ai 

to (Ti. □ 



OCPs in terms of the product algebroid E x TM 

For a control system on an AL algebroid E, similar to the classical situation of the tangent 
algebroid E = TM — )■ M, there is an elegant formulation of the OCPs ([P]) and (IP rel|) in 



terms of the product algebroid E x TM. The idea is to incorporate the cost function into 
the control system (14.21) . 

Denote by A the product algebroid structure on r = {te, ttm) : E x TM — y M x M 
(see Chapter [2]). We will consequently use bold letters to emphasise objects associated 
with A, whereas objects associated with the TM-component of A will be distinguished by 
underlining. For example, cc = (x, x) G M x M and a = {a,a) & E x TM = A. 

Introduce now a new variable x G M and, for a given admissible control u G Uadm, 
consider the following extension of the differential equation 




p(/(x(t),n(t))), 
L{x{t),u{t)). 



(4.4) 



Clearly, x(ti) —x(to) = f^^ L{x(t),u{t))dt is the total cost of the controlled pair {x(t),u(t)) 
of (14. 2p . Equation (14. 4p is a differential equation associated with the following control 
system on A: 

f = (fj) : {M xR) xU — > ExTR = A, (4.5) 

where f {{x,x),u) := {x,L{x,u)) G M x M ^ TM and f{{x,x),u) := f{x,u) G E. For 
a given u G Uadm the base trajectory x(t) = {x{t),x(t)) of (14. 4p contains information 
on both the base trajectory x{t) of (14. 2 p (for the same control u) and the total cost of 
the controlled pair {x{t),u{t)). Observe that the trajectory f{x(t),u{t)) of (14. 4p projects 
onto the trajectory f{x{t),u{t)) of (14. 2 p under the canonical algebroid projection pe '■ A = 
E X TM — > E. Now the OCP ([P]) can be reformulated in terms of control system (14. 5 p 
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as follows: 

minimise x{ti) over controlled pairs {x{t),u(t)) = {{x{t),x{t)),u{t)) 
of fl4.4p satisfying the following: 

1. the E'-projection f{x(t),u(t)) of the trajectory f{x{t),u{t)) (P) 
belongs to a fixed i^^-homotopy class [a]; 

2. x{to) = 0. 

Similarly, the OCP (IP reip can be expressed in the following way: 

minimise x{ti) over controlled pairs {x{t),u{t)) = {{x{t),x{t)),u{t)) 
of fl4.4p satisfying the following: 

1. the i?-projection f{x{t),u(t)) of the trajectory f{x{t),u{t)) (P rel) 
belongs to a fixed relative ii^-homotopy class [a] mod($0) ^i); 

2. xito) = 0. 

The advantage of these new formulations of the OCPs ([P]) and flP rell) presented here 
may seem unclear. The main reason is that the unified treatment of cost and controls 
simplifies some aspects of the proof of the PMP. 



The algebroid homotopy associated with a control system 



As has been observed in [Crainic fc Fernandes, 2003 , algebroid homotopies can be gener- 



ated by time- dependent algebroid sections. Since the control system fl4.2p is a family of E- 
sections f{-,u), fixing an admissible control u(t) gives a time-dependent section f{-,u{t)). 
The associated E'-homotopy can be well understood in terms of Lemma 13.121 

Solving fl4.2p for a one-parameter family of initial conditions x{to, s) = Xo{s) produces 
a one-parameter family of base paths x{t,s). It follows from Theorem IB. 121 that, if the 
solution x{t, 0) is defined on / = [to, ti], then so is x{t, s) at least for a;o(s)'s close enough 
to a;o(0). With x{t, s) we can associate a one-parameter family of trajectories 

ait,s) := f{x{t,s),u{t)). 

One easily sees that for (14. 2 p the assumptions of Theorem IB . 141 are satisfied. Consequently, 
the base trajectories x(t,Xo) are continuous differentiable w.r.t. the initial condition xq 
(and ACB in t). As x{t, s) = x{t, Xq{s)) if s i— >■ Xq{s) is an ACB map, we deduce that x{t, s) 
is ACB w.r.t. the second variable; that is, dsx{t, s) is a well-defined measurable function of 
both variables. Consequently, the derivative dgO^it, s) = ^{x{t, s),u{t))dsX°'{t, s) satisfies 
the assumptions of Lemma 13.121 Thus, the conclusions of Lemma 13.121 hold; namely, for 
a given bounded measurable E-path b^ls) covering Xq{s), there exists a measurable map 
(AC w.r.t. the first variable) 6 : / x [0, 1] — y E with 6(to, s) = bo{s) such that (a, b) is an 
i?-homotopy. The t-evolution of b{t,s) is given by (13. 6p . Observe that, since dsx{t,s) = 
p {b{t, s)), we have dgO^it, s) = ^ (x(t, s),u{t)) {x{t, s)) b^{t, s). Consequently, 6(t, s) ~ 
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s), b^(t, s)) is a solution of the following differential equation 



dx" - . 
+ c5,(x(t, s))V{t, s)f{x{t, s), uit)), (^-S) 

^dtx''{t,s) = p'^{x{t,s))r{x{t,s),u{t)), 

with the initial conditions 6*(to; s) = b^ls) and x°'{to, s) = Xq{s). 

The above differential equation is well understood in terms of the tools introduced 
in Chapter [2j For every u ^ U, the section /«(•) := f{-,u) : M — y E gives rise to a 
linear vector field d-Tifu) on E. Evaluating it on u{t) gives a time-dependent family of 
vector fields dx (/«(*))• Equation fl4.6p is simply the evolution along this family, dtb{t, s) = 
dx (/«(<)) (bi^t^s)). On the other hand, with a time-dependent family of section fu{t) we 
may associate the family of linear functions ht{x,^) := (/(x, on E*, and the 
corresponding family of Hamiltonian vector fields ■ In local coordinates, 

x,,ix,o = p){x)r{xMm.^ + [c^,{x)r{xMmk - p';{x)^^{x,u{m}j d^^. 

As we have seen in Chapter [2] (equations fl2.4p - (l2.6p ). the fields dT(/u(j)) and Xht give the 
same base evolution (given by (I4.2p ). and are related by ^ dx (/«(()), A'/i^)^^ = 0. 

Definition 4.4. The flows of the fields dT(/u(4)) and (for a given u G Uadm) will be 
called operators of parallel transport (in E and E* respectively) along the solution x{t) of 
the system (14. ip . We will denote them with Buq and Bl^^, respectively. Analogously we 
define operators Buq and B*ttQ for the control system (14. 5p . Note that, by construction, 
B,,oB,,^ = Buo andi?;,oi?;,^^^=fi*^. 

Remark 4.5. Let us see that, by construction, the map 6(t, s) = Bu^ {bo{s)) together with 
a{t, s) forms an i?-homotopy. Moreover, Bu^ibo) is continuous w.r.t. b^, t, and t^. Indeed, 
b(t) = Buoibo) is the solution of (14. 6 p for s = 0. The right-hand side is measurable in t 
and locally Lipschitz (linear) in 6, so, by Theorem IB. 13| b{t) is AC w.r.t. t and continuous 
w.r.t. the initial condition b^. 

Remark 4.6. Note also that the operators B and B* have the property of preserving 
the parring (■, ■)^; that is, for every a G E^^^i-^ and ^ G over the same base point 

a;(t') G M, 

(5,,,(a),i?;,(0>, = (a,e>, for every t G /. 

Indeed, since by definition the pairing -^^^ : IE Xtm TE* — )■ M is the tangent map 
of (-, : E Xm -E"* — > M, we have 

9,(5,,,(a),i?;,(0>, = {dtB,,,{a),dtBl,{i))^^ 
= (dTifuit)) {Bu' (a)) , Xf,, (i?;, (0) = 0. 
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Finally, observe that the evolution of ^(t) = B*f.^{$,o) for the control system (14. 5 p is 
trivial on the T*]R-component. Indeed, the associated linear Hamiltonian 

Htix, I) = {fix, uit)), = {fix, + iLix, uit)) 

does not depend on the M-component of ) e M X M; hence = (^(t),^(t)) G 

A* = E* X T*M (in local coordinates, (^,^) ~ {ix"',^i), feO)) evolves due to equations 



df 

dx°- 



ix,uit))Ut) 



dL 

dx"- 



[x,uit))m 



c), ix) f^ix,uit))Ut), 



dm =0, 

xit) =pifixit),uit))) 
xit) =L (x(t),M(t)) . 



(4.7) 



In other words, ^ (t) = is a constant and ^ (t) G E* evolves due to a time-dependent fam- 
ily of Hamiltonian vector fields Xjj^ on E* , where Hfix,^) = (/(x, M(t)), ^)^ + ^pL(x, M(t)). 



Chapter 5 



The Pontryagin Maximum Principle 



In the previous chapter we have introduced OCPs ([P]) and flP reip in the AL algebroid 
setting. The main difference in comparison with the classical formulation are, apart from 
using algebroid-valued velocities, the fixed-homotopy boundary conditions. This new for- 
mulation of the OCPs was motivated in the previous chapter for problems on an integrable 
algebroid E = A{S). In light of these considerations we may thing of (jP]) and ( IP relO as 
of a general framework which includes the standard OCPs as well as OCPs reduced by 
general (groupoid) symmetries. It contains also abstract problems on general AL alge- 
broids. Now we will formulate a generalisation of the Pontryagin maximum principle for 



the problems (|P]) and flP reip . 



Formulation on an AL algebroid E 

Theorem 5.1. Let {x{t),u{t)), with t G [toj^^i]; be a controlled pair of (14. 2 p solving the 
optimal control problem ([P]). Then there exists a curve ^ : [toji^i] — > E* covering x{t) 
and a constant ■Cq ^ such that the following holds: 

• the curve C,{t) is a trajectory of the time- dependent family of Hamiltonian vector 
fields associated with Hamiltonians Ht{x,^) := H [x , , u{t)) , where 

H{x, ^, u) = (/ (x, u) , 0^ + (x, u) ; 

• the control u satisfies the "maximum principle" 

H{x{t),i{t),u{t)) = snpH{xit),^{t),v) 

veu 

and H{x{t),C,{t), u{t)) = at every regular point t of u; 

• ^/'Cq = 0, the covector ^{t) is nowhere-vanishing. 



The above result clearly reduces to the standard PMP (Theorem IC.2P for the case 



of the tangent algebroid E = TM — y M. It also covers the known results for system 
with symmetry on Lie groups and, more generally, principal bundles. A more detailed 
discussion and examples will be given in Chapter [61 

Consider smooth algebroid morphisms $o • TS'o — > E over 0o • •S'o — > M and 
$1 : T^i — > E over (pi : Si — y M. For a relative OCP (IP relO we have the following 
version of the PMP. 
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Theorem 5.2. Let {x{t),u(t)) , with t G [to^^i]? 2;(to) = <Po{zo), and x{ti) = (f)i{wo), be 
a controlled pair of (14. 2 p solving the optimal control problem (IP reip . Then there exists 
a curve ^ : [to;^i] — ^ E* covering x{t) and a constant < which satisfy the asser- 
tion of Theorem \5.1\ and, additionaly ^(to) annihilates $o (T^qS'o) and ^(^i) annihilates 
$i(X.o'5i). 

It is clear that Theorem 15.21 agrees with the standard PMP for problems with general 
boundary conditions (Theorem IC. 31) for the special case of the tangent algebroid E = TM. 



We can regard this result as an extension of the standard PMP to systems with general 
(groupoid) symmetries. In particular, it covers the known results for symmetric systems 
on Lie groups and principal bundles (see Section 16. 2p . 

Obviously, Theorem 15. II is a special case of Theorem 15. 21 obtained for $o and $i trivial. 



Alternative formulation 

Theorems 15.11 and 15.21 have equivalent formulations in terms of the product algebroid 
A = E xTR. 

Theorem 5.3. Let {x(t),u{t)) , witht G [toj^i]? be a controlled pair of (14. 4 p solving the op- 
timal control problem ([P]). There exists a nowhere-vanishing curve ^ = (^,^) : [toj^i] — ^ 
A* = E* X T*M covering x{t), with ^(ti) < 0, such that the following hold: 

• the curve $,(t) is a trajectory of the time- dependent family of Hamiltonian vector 
fields Xnt, for Ht{x, ^) := H{x,$,,u(t)), where 

H{x,^,u) = {f {x,u) ,^)^] 



• the control u satisfies the "maximum principle" 

H{x{t), m.uit)) = sup Hix{t), = 

at every regular point t of u. 

The equivalence of Theorems 15.11 and 15.31 is obvious in light of our previous consid- 
erations. Indeed, the covector ^(t) can be decomposed as (,^(t), ,^(t)) , and its evolution 
along is given by (14. 7p . Consequently, as we have observed at the very end of Chap- 
ter SI covector ^{t) = C,^ is constant and the evolution of ^{t) is given by Xfjf Since 
H{x,^,u) -\- ^qL{x,u) = H{x,^,u) for ^ = (C,^^), and x = {x,x), the corresponding 
statements in Theorems 15. II and 15.31 are equivalent. 

Define now So := %{TzoSo) C E^(^to) and Si := $i(T,„„S'i) C -E^(ti), where x(to) = 
4>q{zq) and x{ti) = (f)i{wo). We have the following reformulation of Theorem 15.21 

Theorem 5.4. Let {x(t),u{t)) , with t G [toj^i] be a controlled pair of ( 14. 4 p solving the 
optimal control problem (IP reip . Then there exists a nowhere-vanishing curved, : [to7^i] 
A* covering x(t), which satisfies the assertion of Theorem \5.!^ and, additionally, £(to) 
annihilates Sq © Ox(to) ^(^i) annihilates Si © ^x(ti)- 
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The equivalence of Theorems 15.41 and 15.31 is clear. 

Remark 5.5. There are many different versions of the PMP — for autonomous and 
non-autonomous systems, with mowing or fixed end-points, with free or fixed time in- 
terval [toj^i]; etc. Theorem 15. 4[ in fact, covers all these cases (under certain regularity 
conditions). For details see Section [GTTl 



Chapter 6 



Discussion of the main result 



This part is devoted to the discussion of our main results formulated in the previous 
chapter. We begin with formulating and proving a version of the PMP on AL algebroids 
for non-autonomous systems. In section 16.21 we formulate a version of the PMP on for 
invariant OCPs on Lie groups and principal bundles. We derive Montgomery's falling 
cat problem as an illustration. Later we use the PMP to derive the known results form 
the calculus of variation on Lagrangian reduction, Hammel equations and Euler-Poincare 
equations. We also formulate an algebroid analog of Euler-Lagrange equations. Finally, 
in section [6l3] we give a few concrete examples of the usage of our results. 



6.1 Non-autonomous versions of the PMP 



In [Pontryagin et al, 1962 analogs of the PMP for other versions of the classical OCP (jPj) 



(including fixing the time interval, or changing the setting to the non-autonomous systems) 
were obtained. These extensions were proved by a clever reformulation of a problem given 
in order to make it a special case of the already known solution. Now we perform similar 
derivations for the extensions of the problems ([P]) and flP rell) . 

Consider a non-autonomous version of the control system ( 14. 2p on an AL algebroid E 

xit)=p{f{xit),t,um, (6.1) 

where / : M x M x t/ — > E is a time- dependent family of C^-sections of E. Moreover, 
we assume that / is continuous w.r.t. all variables, differentiable w.r.t. x and t, and that 
the derivative T(^x,t)f is also continuous w.r.t. all variables. 

Let L : M X M X f/ — > M be a non-autonomous cost function satisfying the same 
regularity assumptions as /. Per analogy to definitions introduced in Chapter H] we will 
speak of trajectories f{x{t),t,u{t)) and extended controlled pairs {x{t),t,x{t)) of (16. ip . 

Consider now the following generalisation of the OCP ([P]) : 



rti 

mmimise / L{x{t),t,u{t))dt over all extended controlled pairs (x, t, u) 

Jto (Pna) 

of (16. ip s.t. the £^-homotopy class of the trajectory f{x{t),t,u{t)) equals [a]. 

Here [a] is a fixed E'-homotopy class. We allow the time interval [toi^i] either to be fixed 
or to be unspecified. 
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We can define also a relative version of the above problem by substituting the fixed- 
£'-homotopy class [a] by a fixed relative- i?-homotopy class [cr] mod($oj "^'i)) for a pair of 
smooth algebroid morphisms $o • TS'o — > E and $1 : TSi — )■ E. 
For the above non-autonomous OCPs we have the following extension of Theorem 15.11 

Theorem 6.1. Let {x{t),t,u(t)) , with t G [^07^1]? ^.n extended controlled pair of (16. ip 
solving the optimal control problem ([P^. Then there exists a curve C, '■ [to,ti] — > E* 



covering x{t) and a constant < such that the following holds: 

• the curve C,{t) is a trajectory of the time- dependent family of Hamiltonian vector 
fields associated with Hamiltonians Ht{x,^) := H{x,t,C,,u{t)), where 



H{x, t, ^, u) = (/ (x, t, u) , 0^ + {x, t, 



u 



• the control u satisfies the "maximum principle" 

H{x{t),t, u{t)) = sup H{x{t),t, ^{t),v) 

and H(x{t),t,$,{t), u{t)) — J^* s, ^(s), u(s))ds = const at every regular point 

t of u. If the time interval [tQ,ti] is unspecified then this constant is 0; 

• ^/^Q = 0, the covector ^{t) is nowhere-vanishing. 

Proof. The proof requires a simple reformulation of the given data. Consider, namely, the 
control system 

7= (/, 1) : M X M X — > ExTR 
on the product algebroid E x TR with the associated base dynamics 

x{t) = p{f{x{t),z{t),um, 

z{t) = 1. 

Here {x, z) G M x M. The variable z plays a role of time. Indeed, regardless of the chosen 
admissible control u{t), the solution of the equation z{t) = 1 with the initial condition 
^ito) = to gives z{t) = t. 

Now, if the time interval [to, ti] is fixed, OCP 
control system / with unspecified time interval and the E x TM-homotopy class defined by 
[cr] on E and [to, ti] on TR. Consequently, we can use Theorem 15. ll to obtain the necessary 
conditions for optimality. 

For a) e E* X T*M we define the Hamiltonian 

H{x, z, ^, «,«): = (7(x, 2, u), (^, a)) + ^oL{x, 2, u) = 

= (/(x, z, u),0^ + ^oL{x, z,u) + l-a=: H{^, z, u) + a. 



Pna) is equivalent to the OCP (|P]) for the 
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Now the evolution of the Pontryagin covector {^{t),a{t)) reads as 

ew = ^l(.,.M*))(^W) 

Since z{t) = t and H{x{t), z{t),C,{t), <y{t), u{t)) = at regular t, we get 

a{t) = c- ^H{^{s),s,u{s))d 

and 

H{^{t),t, u{t)) + a{t) = at t regular. 

The maximum principle for H follows directly from the maximum principle for H. Finally, 
if .^0 = and C,{t) = 0, we would have H{$,{t),t,u{t)) = 0, and hence also a{t) = a.e., 
which is impossible. This proves the assertion. 

The proof for the case of unspecified time-interval [toj^^i] is analogous, yet instead of 
fixed-homotopy class boundary conditions we have to general boundary conditions asso- 
ciated with algebroid morphisms $o = (^^o j id) : TM — y E x TM and $i = {O^^ , id) : 
TM — y E X TM. The additional condition c = now follows from the transversality 
conditions of Theorem 15.21 for a (to) and a{ti). □ 



6.2 The known results 

The PMP on Lie groups and principal bundles 

The already proven results on the Lie groupoid — Lie algebroid reduction of a control sys- 
tem and homotopy (cf. Theorem 13. 6[ Corollary 13. 8[ and Chapter H]) allow us to formulate 
the following result which can be understood as a general reduction scheme of the PMP 
on a principal G-bundle. Consider a principal G-bundle G — )■ P A M. 

Theorem 6.2. Let F : P x U — y TP be a G-invariant control system on P and let 
L : P X U — y M. be a G-invariant cost function. Choose a path S : [to;^i] — ^ P joining 
two fixed points Po,Pi G P. 

Then the OOP (IP2D on P for a fixed homotopy class [S] in P is equivalent to the OOP 
flPj) for the system f : M x U — y E = TP/G where /(7r(p),n) := [F{p,u)], with the cost 
function I : M x U — y M defined by 1{tt{p),u) := L{p,u), and the E-homotopy class [a] 
being the reduction of [S] . 

Now applying Theorem 15. II to the OCP described above we obtain a general result for 
equivariant OCP on principal bundles described in therms of the linear Poisson structure 
Ue* on E* = T*P/G (cf. Theorem IM])- 
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Theorem 6.3. Let {p{t),u(t)) , with t G [to7^i]; be a controlled pair of F solving the OCP 
described above. Denote by x{t) the base projection of p(t). Then there exists a curve 
^ : [to;^i] — T*P/G covering x{t) and a constant < such that the following holds: 

• the curve C,{t) is a trajectory of the time- dependent family of Hamiltonian vector fields 
Xht associated with the linear Poisson structure He* on T*P/G and Hamiltonians 
ht{x,^) := h{x,^,u(t)), where 

h{x, ^, u) = (/ (x, u) , + (x, u) ; 

• the control u satisfies the "maximum principle" 

hixit),^{t),u{t)) = sup h{x{t),m,v) 

and h{x{t) , ^{t) , u{t)) = at every regular point t of u; 

• if^^ = 0, the covector C,{t) is nowhere-vanishing. 

An analogous result (with additional transversality conditions) is valid for system with 
general boundary conditions. 

Note that for the case of a Lie group {P = G, M = {*}, He* = Hg*) we recover the 
results of Jurdjevic [Jurdjevic, 1997[ Ch.l2, Thms 5,6]. 



An application — the falling cat problem 

Now we will reconsider the well-known results of Montgomery [Montgomery, 1990] (see 
also [Bloch, 2003 ch. 7.1] and [Cendra et ai, 1998| ) on the isoholonomic problem by 



means of the PMP in the Atiyah algebroid setting. 

Let G — )■ P — )■ M be a principal G-bundle, let "H C TP be a G-invariant horizontal 
distribution, and let /i(-, ■) be a G-invariant sub-Riemannian metric on T-L (//(■, ■) can be 
understood as a base metric lifted to by the horizontal lift). The problem is now to find 
a horizontal curve q{t) with t G [0, 1] joining two fixed points Qq, qi in P and minimizing 
the total energy 

Clearly, due to the G-invariance of the problem, after changing the fixed-end-point 
condition into a fixed-homotopy condition (as discussed in detail in Chapter Hj), the above 
problem is equivalent to an OCP of the form ([P|) on the Atiyah algebroid E = TP/G. 

With the invariant distribution "H, understood as a principal connection, we can as- 
sociate a map V : TM — )■ E inducing a splitting E TM x g. Our control system 
will be / : TM — y TM x q given by f{X) = (X, 0) (this assures that the trajectory is 
horizontal), the cost function L : TM — )■ M reads as L{X) = |/i(X, X), and the fixed 
P-homotopy class is simply a reduction of a classical homotopy class in P. 

Note two differences with the formulation of the OCP ([Pj). Firstly, our control and 
cost functions have arguments in TM instead of in M x U. Of course, this makes no big 
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difference, since locally TM ^ M x M". Secondly, our time interval is fixed. This, in turn, 
results in substituting the condition H{x(t),C,{t),u{t)) = by H{x{t),^{t),u{t)) = const 
in the assertion of Theorem 15.11 (cf. Section I^TT]) . 

Now we can apply Theorem 15.11 with the Hamiltonian evolution described in Theorem 
I A. 71 The covector E E* can be decomposed as = (p, C) ^ T*M x q*, and the 
corresponding Hamiltonian is 

H{p,C,X) = {X,p) + ^Xo^i{X,X) =: h{p,X), 

with Aq < 0. The maximum principle reads as p{t) = — Aoyu(X(t), ■); hence on the optimal 
trajectory, (^(t), X(t)) = — |Ao/i(X(t), (which is constant in t). The evolution 

of p{t) and ({t) is given by 

CW = o, 

pW = '^/j;5) + (ew,i^v(^,-)>; 

hence ({t) = const. The second equation is equivalent to 

AoV^X = (C,Fv(X, ■)>*", 

where denotes the Levi-Civita covariant derivative on (M, fi) and is the vector 
dual to A by means of /i. Indeed, the equation p{t) = X^f^J^x)^ together with p{t) = 
— Ao/i(X(t), ■), is the PMP for a geodesic problem on {M,fi). Passing to the dual vector 
p{t)'^^ = XoX{t) we should obtain the geodesic equation multiplied by the factor Aq. The 
equation = means that the curve ({t) G Q* is covariantly constant, hence 

VxC = 0. 

We have thus obtained the Wong equations as in [Montgomery, 1990 . 

The abnormal case Aq = implies p{t) = and (C,Fv(J^, ■)) = 0. This allows us 
to exclude abnormal solutions in certain situations. For example, if P is a bundle of 
circles over a two-dimensional base and the connection is non-integrable (i.e., is non- 
vanishing), we have (^(^,F^{X, ■)) = if and only if X = (hence the solution is trivial) 
or ( = 0, which can be excluded by the non-vanishing of the covector in the PMP. 



Applications to variational problems 

It is a well-known fact that Euler-Lagrange equations can be derived by means of the 
classical PMP if one considers a trivial control system on a manifold M 

/ : M X M" ^ TM ^ TM. 

loc 

In this case, since we make no restrictions for velocities, the abnormal case can be excluded. 
Similarly, for a trivial control system on a general AL algebroid 

f : M xW ^ E ^ E, 

loc 
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we can obtain generalised Euler-Lagrange equations studied by many authors (see e.g. 
[Grabowska fc Grabowski, 2008 and the references therein). 



Indeed, for a system of the above form with a cost function 

L: M ^ E — 

loc 

consider the OCP ([P]) for some fixed homotopy class [a] and fixed time interval [to;^i] 
(cf. Section [6.ip . and denote by 7 : [to,^i] — ^ E its solution (the controlled pair). 
In local coordinates 7(t) ~ {x°'{t),y^{t)). The associated time-dependent Hamiltonian 
H -.Rx E* — >R reads as 

The maximum principle 

H{t,m)= sup {e,at)) + ^oHe) 

implies that if ,^0 = 0, then also ^{t) = 0, which is forbidden by the PMP. Conse- 
quently, we may assume that .^0 = Now the maximum condition implies that the 
Pontryagin covector ^{t) is a vertical part of the derivative dL evaluated on 7(t); i.e., 

e(t) =T*7r(dL(7(t))) ~ (x^{t),mx{t),y{t)) 



The evolution equation reads as 

i{t) = IlE^{d^H{t,at))), (6.2) 

where He* '■ T*E* — y TE* is induced by the linear bi- vector field He*- 

For our purposes it will be more convenient to describe the dynamics via the canonical 
double vector bundle isomorphism TZ^^ : T*E* — y T*E (see [Mackenzie, 2005 Sec. 11]), 
which in local coordinates reads as 

7^-l : (x^e^,p^>,y'■) ^ (a;^z/^-Pb,eJ)• 

Since d^H{t,0 ~ {x'^ {t) , ^ {t) , -§^{x{t),y{t)),y%t)), the image U-' {d^H{t,m)) is sim- 
ply the derivative dL evaluated at ■y(t). Equation (16. 2p can be thus expressed as 

^TM7(t))=^odL(7(t)), 

where e := He* o '■ T*E — y TE*. This equation considered as an implicit differ- 
ential equation for 7(t) is precisely the generalised Euler-Lagrange equations considered 
in [Grabowska fc Grabowski, 2008[ [Grabowska et al, 2006| . In local coordinates it reads 



as 

dx" 



Ptix)y' 



dt \dyi J 'dy^ "^^^ ' dx''' 
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In a special case if E = g is a Lie algebra we recover the Euler-Poincare equations 

A f^'] = A* 

dt\dyj "{dy 

More generally, for the Atiyah algebroid E = TP/G, generalised Euler-Lagrange 
equations (16. 3p take a from of Hammel equations (if we use local trivialisation defined 
by a local section — see (1A.3P ) and reduced Euler-Lagrange equations (in local trivial- 
isation given by a principal connection — see (1A.4|) ) The interested reader should con- 
front [Cendra et ai, 1998 Sec. 5]. 



6.3 Other examples 
Two-point time OCP on 50 (3) 

Consider now a rigid body in which can rotate with constant angular velocity along 
two fixed axes in the body. At every moment the position of the body is described by an 
element q G 5*0(3). The rotation axes can be represented by elements of the Lie algebra 
/+, G so (3). The rotation along the axis l± is described by the equation 

dtq = ql±. 

It would be suitable to write = a + b and = a — b. The above equation can be regarded 
as a control system on the Lie group 50(3) with the control function E{q,u) = qf{u), 
where f{u) = a + ub and the set of controls is simply U = { — 1,1}. We would like to find 
a control u(t) which moves the body from a position go ^ 50(3) to qi G 5*0(3) (or such 
that the trajectory belongs to a fixed homotopy class in 5*0(3)) in the shortest possible 
time. 

It is obvious that the above OCP on the Lie group reduces to the OCP on the Lie 
algebra so (3) with the control function / and the cost function L = 1. Fix a basis 
(61,62,63) on so(3), and denote by c'^^ the structure constants of the Lie algebra in this 
basis. Let u{t), for t G [toj^i]; be a solution of the above OCP. It follows from theorem 15. II 
that there exist a number Aq < and a curve ({t) G so (3)* such that 

H{C{t),u{t)) = (C(t), a + u{t)b) + Ao = max (C(t), a + vb) + Aq. 

v=±l 

This implies that u(t) = sgn (^C(t),6)). Moreover, the evolution of C(t) is given by the 
equation 

dtUt) = cl^{a'^ + uit)b'^)C,{t). 



We have obtained the same equation as in ( [Agrachev fc Sachkov, 2004 Sec. 19.4]). We 



refer the reader to this book for the detailed discussion on solutions. 
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An application to a nonholonomic system 



In [Grabowska et ai, 2006 and [Grabowska fc Grabowski, 2008| a framework of geometric 



mechanics on general algebroids was presented. Roughly speaking, the structure of an 
algebroid on a bundle t : E ^ M allows one to develop Lagrangian formalism for a 
given Lagrangian function L : — )■ M. Moreover, if E is an AL algebroid, then the 
associated Euler-Lagrange equations have a variational interpretation: a curve 7 : [to;^i] 
E satisfies the Euler-Lagrange equations if and only if it is an extremal of the action 
•^(7) '■— It^ L('y(t))dt restricted to those 7's which are admissible and belong to a fixed E- 



homotopy class [Grabowska fc Grabowski, 2008 . Hence, the trajectories of the Lagrange 



system should be derivable from our version of the PMP for the unconstrained control 
system on E with the cost function L. 

In Grabowski et ai, 2009| it has been shown that if D G E is a subbundle and L is 



of mechanical type (that is, L{a) = |/i(a,a) — V^(r(a)), where is a metric on E and V 
is an arbitrary function on the base), then nonholonomically constrained Euler-Lagrange 
equations associated with D can be obtained as unconstrained Euler-Lagrange equations 
on the skew-algebroid {D,pe\d, [■, ■]d '■= Pd[-, ■]e), where P^j : E ^ D denotes the projec- 
tion orthogonal w.r.t. /i. It follows that if D with the algebroid structure defined above is 
AL, then the solutions of the nonholonomically constrained Euler-Lagrange equations are 
extremals of the unconstrained OOP on D with the cost function L\£). On the other hand, 
using our version of the PMP on the algebroid E with controls restricted to D and the 
cost function L, one will obtain nonholonomically constrained Euler-Lagrange equations 
associated with D. Note that the algebroid bracket [■^■\d need not satisfy Jacobi identity 
even if [■■,-\e does. Concluding, the PMP on general (not necessarily Lie) AL algebroids 
can be used in the theory of nonholonomic systems. To our knowledge this point of view 
is completely novel. 

To give a concrete example we will use PMP to study the Chaplygin sleigh. It is an 
example of a nonholonomic system on the Lie algebra se(2) which describes a rigid body 
sliding on a plane. The body is supported in three points, two of which slide freely without 
friction, while the third point is a knife edge. This imposes the constraint of no motion 
orthogonal to this edge (see [Chaplygin, 1911 Neimark fc Fufaev, 1972| ). 



The configuration space before reduction is the Lie group G = SE{2) of the Euclidean 
motions of the two-dimensional plane M^. Elements of the Lie algebra se(2) are of the 
form 

/ LO Vi_\ 

^ = -cu = viEi + V2E2 + UJE3, 

\ 0/ 

where [^3,^1] = E^, [^2,^3] = ^1, and [^1,^2] = 0. 

The system is described by the purely kinetic Lagrangian function L : se(2) — ?> M, 
which reads as 

L(t>i, t>2, u) = - [{J + m(a^ + &^))u;^ + mvl + — 2hmujVi — 2amuv2\ ■ 

Here m and J denote the mass and the moment of inertia of the sleigh relative to the 
contact point, while (a, h) represents the position of the centre of mass w.r.t. the body 
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frame, determined by placing the origin at the contact point and the first coordinate axis in 
the direction of the knife axis. Additionally, the system is subjected to the nonholonomic 
constraint determined by the linear subspace 

D = {{vi,V2,u) e se(2) \v2 = 0} C se(2). 

Instead of {Ei, E2, E^} we take another basis of se(2): 

ei = E3, 62 = El, 63 = —maEs — mabEi + ( J + ma^)E2, 

adapted to the decomposition D © D-^; D = span {61,62} and D-^ = span {63}. The 
induced skew-algebroid structure on D is given by 

ma mob 

ei,62 D = — j6i + — ^62. 

Therefore, the structural constants are Cf, = . ™" o and C?, = -rr^^. The algebroid D is 
almost Lie (in fact, in this simple case it is a Lie algebra). Next, we will use theorem 15.11 
to derive the nonholonomic equations of motion. Set t/ = 3 {y^,y^) and the control 
function to be a map f : U ^ D given by 

f{y\y')=y'ei + y'e2eD. 

The Lagrangian restricted to D defines the cost function L : U ^ M., 

L{y\ y') = \[{J + ^(a' + + ^{y^f - 2bmyV] • 

For a curve ^(t) = ^i{t)el + ^2(^)62 € D* the maximum principle reads 

Hm,yit)) = my' + my' + i,-L{y\y') (6.4) 

= max JUty + + ^0 ■ L{v\ v')) . 

If C,„ = 0, then maximality would give ^{t) = 0, which is impossible. Hence, we may 
assume that = —1. Now from (16. 4p we will get 

^,(t) = ( J + m{a^ + 62)) _ 6,^2/2 ^ 

^2(^) = ■'Tiy^ — bmy'^ . 

Finally, the Hamiltonian evolution (14. 7p is simply 

ei = Cl,y% + Cl,y% = -y^yi^i + &6), 

J + ma"' 

^1 = Ciy^i + Cl,y'i2 = + &6). 

J + ma"' 

In view of (16. 5p and the above equations we conclude that the equations of motion are 

(J + m{a^ + b'^))y^ — bmy^ = —may^y'^, 
my'^ — bmy^ = ma{y^Y, 

which completely agrees with [Grabowski et ai, 2009 . 



Chapter 7 



Needle variations 



In order to prove Theorems 15 . 3 1 and 15 . 4 1 we shall somehow compare the cost on the optimal 
trajectory f{x{t),u{t)) with costs of nearby trajectories. As our assumptions input on 
the set of controls U are very mild, we cannot use the natural concept of a continuous 
deformation, as in the standard calculus of variations {U can be for instance discrete). 
Instead, we introduce the notion of needle variations after [Pontryagin et ai, 1962| . For 
a given admissible control u : [toj^^i] — ^ U this variation will be, roughly speaking, the 
family of controls Us{t) obtained by substituting u(t) by given elements f » G f/ on a small 
intervals Jj = (rj — sSti,Ti] C [to^^i]- Our main result in this chapter is Theorem 17.41 
where we study the A-homotopy classes of the trajectories of the system (14. 4p obtained 
for controls Us(t). We finish this chapter with the definition of KJ^ — the set of infinitesimal 
variations of the trajectory f{x(t),u{t)). 

Needle variation of controls and trajectories 

Throughout this chapter we will work with a fixed admissible control u : [to ^i] — ^ U and 
fixed trajectory a{t) := f{x{t),u{t)). 

Choose points to < Ti < T2 < . . . < < r < ti, being regular points of u. Next, choose 
non- negative numbers 6ti, . . . ,6tk and an arbitrary real number St. Finally, take (not 
necessarily different) elements f 1, . . . , G U. The whole set of data (rj, Vi, r, 6ti, 5t)i=i,...,fc 
will be denoted by to and called a symbol. Its role will be to encode the variation of the 
control u(t). Intuitively, points Tj emphasise moments in which we substitute u{t) by a 
constant control Vi on an interval Jj = (rj — s5tj, Tj] of length s6ti, while s6t is responsible 
for shortening or lengthening the time for which u{t) is defined. The precise definition is 
quite technical, because one should take care to make the intervals Jj pair-wise disjoint. 

Take 

{5t — {6ti + . . . + 6tk) when Tj = r; 
- {6ti + . . . + 5tk) when n = tj, < r; 
- {6t.i + . . . + 6tj) when Tj = Tj+i = . . . = tj < r^+i, 

and define s-dependent intervals Jj := (tj + sli, Ti + s{li + 6ti)]. As we see, Jj is left-open 
and right-closed and it has length s ■ 6ti. If Ti < Tj+i, or i = k and Tk < t, the end-point 
of Jj lies at Tj. If Tj = Tj+i, then the end-point of Jj coincides with the initial-point of Jj+i. 
If Tk = T, we set the end-point of J^ at r + s6t. Clearly, for s small enough, the intervals 
Jj lie inside [toj^i] and are pairwise disjoint. 
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Definition 7.1. For a symbol tt) = {Ti,Vi,T,Sti,St)i=i^,,,^k we introduce a s-dependent 
family of admissible controls defined on intervals [to,ti + s6t]: 



We will call a (needle) variation of the control u associated with the symbol tt). 

Using u^{t) and an AC path s ^ Xq[s) G M x M where a;o(0) = xq we can define the 
variation of a{t). 

Definition 7.2. The family of trajectories 



of the system (14. 4p . with the initial conditions x{tQ,s) = xq{s), where t G [to,ti + s6t], 
will be called a variation of the trajectory a{t) = f{x{t),u{t)) associated with the symbol 
ro and the initial base-point variation Xo{s). 

Remark 7.3. Observe that, when 6ti = 0, the interval Jj is empty. It follows that adding a 
triple (tj, Vi, 5ti = 0) to the symbol Iti does not change the variation u^^ and, consequently, 
the associated variations a(t, s). 

Needle variations and A-homotopy classes 

Our goal now is to compare the A-homotopy classes of the trajectory a{t) and its variation 
a{t, s) introduced above. We need this because OCPs ([P]) and (IP reip are defined in term 
of algebroid homotopy classes. Having in mind Lemma 13.121 and the construction of a A- 
homotopy associated with a control system (14. 4p given in Chapter HI we may expect that 
the family of trajectories a{t, s) forms an A-homotopy (for some initial-point homotopy 
6o(s)). Consequently, the description of A-homotopy classes of a{t,s) should be possible 
by meas of Lemma 13.151 This is indeed the case, yet some technical work is needed in 
order to reparametrise a{t, s) in a suitable way. 

Theorem 7.4. Let s t— )■ bo(s) be a bounded measurable A-path covering s i— )■ Xq{s), where 
Xo{0) = Xq. Consider a variation a{t,s) = f{x{t,s),u'^{t)) of the trajectory a{t) = 
f{x{t),u{t)) associated with a symbol Itt = {Ti,Vi,T,6ti,6t)i=i^^^^^k o-nd initial base-point 
variation Xq{s). 

Then there exists a number 9 > and an A-path s i— ?• d"'(s) defined for < s < 6 such 
that 



for every e < 6. 

Moreover, if {Ti,Vi,T) in tv are fixed, we can choose 6 > universal for all {Sti,St) 
belonging to a fixed compact set. 




(7.1) 



a{t,s):=f{x{t, s),<(t)) 



[bo{s)]se[0,e]Ht,e)]te[to,h+e5t] = [a{t)]te[to,h][d'^is)]se[0,e] 



(7.2) 
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Finally, if bQ{s) is regular at s = 0, then d^{s), regarded as a function of s, Sti and 
6t, is uniformly regular w.r.t. 6ti and 6t at s = 0. What is more, 

d«(0) =Bt,Afi^ir), uiT))]6t + Bt^tMO)) 

(7.3) 



+ f{x{n),Vi) - f{x{Ti),u{Ti)) 



6ti E A 



x{ti)- 



i=l 



Proof. The proof is technically complicated, yet conceptually not very difficult. The idea 
is to decompose a(t, s) into several parts, which, after a suitable reparametrisation, form 
an A-homotopy. As one may have expected, these parts correspond to "switches" in the 
needle variation associated with the symbol tn. Our argument will be therefore inductive 
w.r.t. k — the number of "switches" in W. Formula f l7.2[l will be obtained from the repetitive 
usage of Lemma 13.151 for the partial homotopies, and (17. 3p will follow from the concrete 
form of these homotopies. The preservation of the uniform regularity will be obtained 
using the technical results introduced in Appendix IB.li 

Finally, let us explain the role of the number 6. We know from Theorem IB. 121 that 
if a solution of the ODE for a fixed initial condition Xq is defined on an interval [toj^i]? 
then so are the solutions for initial conditions close enough to x^. Since the base variation 
x(t,s) associated with u^{t) is obtained as a composition of the solutions of (14. 2 p with 
perturbations on intervals of length sSti and s6t, it is clear that, if numbers 6ti and 6t 
are bounded and Tj, r and Vi fixed, for a given Xq{s), we can chose 6 > such that the 
trajectory x{t, s) will stay close enough to x[t) to be well-defined for all < s < 6' and all 

In our inductive reasoning it will be more convenient to assume that all the data 
depends on an additional parameter p E P (i.e., we have Xq{s,p) instead of Xq{s), a{t, s,p) 
instead of a{t, s), etc.). In the assertion we demand that (17.21) and (17.31) hold for each fixed 
p E P. Moreover, for fixed {Ti,Vi,T) we want <i"'^(s) to be uniformly regular w.r.t. p, 6ti, 
and 5t at s = if bo{s,p) is uniformly regular w.r.t. p at s = 0. 

In what follows we will need two technical lemmas. 

Lemma 7.5. Lett ^ a{t,s,p) = f{x{t,s,p),v{t)), with t E [to)^i]; be a family of bounded 
measurable admissible paths over x{t, s,p) parameterised by p E P. Let s i— )■ bo{s,p) be a 
family of bounded measurable A-paths over x{to, s,p). There exists a number 6 > and a 
family of bounded measurable A-paths s ^ di{s) defined for < s < 6 such that 

[4(s,p)]se[o,£][/(a;(t,e,p),^;(t))]tep„j,] = [fix{t,0,p),v{t))]^^[^^j^^[d{{s)]se[o,e], (7.4) 
for all e < 9. 

Explicitly, d^{s) = bQ{s,p) , where is a parallel transport operator associated 



tto 



with^the control v(t) . Moreover, ifbo{s,p) is uniformly regular w.r.t. p at s = 0, then so 
is dl{s). 



Proof of the lemma. Fix p E P and consider b{t,s,p) := B'^~ bo{s,p) 



. It follows from 



the definition of the operator of parallel transport B'"~ that the pair {a{t, s,]5), b(t, s,p)) is 
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and A-homotopy over x(t, s,p) (see Remark l4.5p . Now (17. 4p follows directly from Lemma 
13T5i since b{ti,s,p) = B~~ bo{s,p) = d^{s). 



Finally, since by Remark 



4.51 the map B~~ (■) is continuous for every fixed ti and to, 

□ 



in light of Lemma [B.IH it preserves the uniform regularity of bQ{s,p) . 
The second lemma is the following one. 

Lemma 7.6. Let t ^ a{t,s,p) = f{x{t,s,'p),v{t)) be a family of bounded measurable 
admissible paths over x{t,s,p) parametrised by p & P. Let s t— )■ 6o(s,p) be a family of 
bounded measurable A-paths over x{to + sc, sj)). Then there exists a number 6 > and a 
family of bounded measurable A-paths s d2''^''^{s) defined for < s < 9 such that 



[bo{s,p}]se[0,e][fixito + t,e,p},v{t))]t(.[ec,sed] = [(P/''^{s)]se[0,e], 



(7.5) 



for every e < 9. 

Moreover, if bo^s^p) is uniformly regular w.r.t. p at s = and tg is a regular point of 
the control v(t), then <i2'^''^(s) is uniformly regular w.r.t. p, c, and d at s = 0. Finally, 

4''^\0) = bo{s,p) + {d- c)f{x{to,0,p),v{to)). (7.6) 
Proof of the lemma. For notation simplicity let forget about the p^dependence. Define 



bo{s) 



B 



to{to+Sc) 



bo{s) - cf{x{to + as), v{to + as)) 



Clearly, 6o(s) is an admissible paths over x{tQ, s). Now define a pair of maps 
a(t, s) = sf {x(to + ts, s),v(to + ts)) , 



bit,s) 



B 



{to+ts)to 



bois) 



tf [x{to + ts,s),v{to + st)) 



where t G [c, d] and s G [0, 9]. We shall prove that this pair is an A-homotopy. 

If this is the case, then clearly (17. 5p follows form Lemma 13.151 since the initial-point 
A-homotopy is 



'{to+cs)to to{to+sc) 



bn(s) 



+ of {x{to + sc),v{to + so)) = bo{s 
the final-point A-homotopy is 



/ {x{to + sc),v{to + so)) 



d^/is) ■.=b{d,s) 



B 



{to+ds)to 



bo{s) - cf {x{to + sc),v(to + so)) 



+ 



+ df [x{to + sd),v(to + sd)) , 

and, by LemmaEHl [a(^, s)]te[c,d] = [fi^o + s),v(to + tyj^^j^^ ^^^j 
for d2 (s) at s = we get (17. 6p . 



. Evaluating the formula 
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Finally, d'^'^^s) is uniformly regular if bo(s) is and to is a regular point of v(t). Indeed, 
we can use the results from Appendix IB. 1[ The point is to observe that d2''^(s) is obtained 
from measurable maps v{tQ + s) and boi^s) regular at s = by operations described in 
Propositions IB.6l - IB.9l and Lemmas IB. lOllBTT] which preserve the uniform regularity. One 
has also to use the fact that (bo), f{x, u), and x{t, s) are continuous maps (cf. Remark 

ra. 



Now it remains to check that a{t, s) and b{t, s) are indeed an A-homotopy. Let us 
calculate the WT-derivatives: 



dsa\t, s) =V {x{to + ts, s), vito + ts)) + tsdif {xH s), vit)) 
+ sdj' {x(t,s),v{t)) 



+ 



and 



d,b%s)''=\B'^^ 



b,(s] 



t=to+ts 



f {x{to + ts,s),v{to + ts)) 



t=to+ts' 



Now, since / s), f (t)) and 



bc^(s) 



is an A-homotopy (cf. Lemma [7.5p . we have 



Consequently, 



d,f {x{ls),vit))'^=^c],ixils))B^^^ 



tto 



bois) 



f {x(t,s),vit)). 



dtb\t, s) — dsa{t, s 



WT 



bJs] 



d,r {x{is),v{t)) 



t=to+ts 



WT 



sc),{x{l s))B^-^^ [bo(5)] f {x{l s), v{t)) 
ck(x(to + ts, s))b^'(t, s)a''{t, s). 



t=to+ts 



□ 



No we return to the inductive proof of Theorem 17.41 We will prove first that the 
assertion is true for ti = r. Our argument will be inductive w.r.t. k — the number of 
switches in the symbol W = {Ti,Vi, t, Sti, 6t)i=i^^^^^k. 

Step 1, A; = 0. We start with k = 0. This means that u™(t) = u{t). For 6t = we 
simply have a(t,s) = f{x(t,s,p),u(t)) with t G [tcT], where x{tQ,s,p) = Xq{s,p). Now 
we can use the Lemma 17751 taking to = to, ti = t, p = p, bQ{s,f>) = 6o(s,p), and v(t) = u{t) 
to get the assertion. 

If 5t 7^ 0, things are a little more complicated. We have a{t,s,p) = f{x{t,s,p),u{t)) 
where t e [to, t + s6t] and x(to, s,p) = xq{s,p). We can decompose 



[/(a;(t,e,p),u(t))],g[,^_^^^^,] 

= [/(x(t,5,p),M(t))],gj,^^^^j ■ [/(a;(t,e,p),M(t))],gj^^^^^5,j . 



(7.7) 
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Now using the assertion for St = we get 

[bo{s,p)]se[o,e][f{x{t,e,p),u{t))]te[to,T] = [f{x{t,0,p),u{t))]te[to,T][di{s)]se[o,eh (7-8) 

where d^{s) is uniformly regular w.r.t. p aX s = 0, and dJ^{0) = S^f(,[6o(0,p)]. Next, using 
Lemma [72] for to = t, c = 0, d = 6t, p = p, 6o(s,p) = dl{s), and v{t) = u{t), we get 



[d{{s)]sG[0,e][f{x{T + t,e,p},v{T + t))]t^[0^,St] = [4'''*(s)],6[o 



(7.9) 



where <i2''^*(s) is uniformly regular w.r.t. p, and St at s = and 



dF/\0) = dm + Stf{x{T,0,p),u{T)). 



Multiplying fTTSj) by [/(a;(r + t, e,^), t;(r + t))]tg[o,e5t], using (I7]7]) and (I7]9]), and taking 
d"''P(s) := <i2'^*(s), we get the assertion. 

Step 2. Assume that the assertion holds for all / < k. Consider a symbol Iti = 
{Ti,Vi, T, Sti, St)i=i^^^^^k. We will distinguish the following two situations: 
Situation 2. A. Not all Tj are equal. In particular, 

to < Ti < . . . < n < n+i < . . . < Tk <T 

for some / < k. We can now use the inductive assumption for a symbol Wi = {Ti,Vi,T = 
Ti,Sti,St = 0)i=i_...,i to get 



[bo{s, P)]se[o,e] [f{x{t, e, p),u^^ {t))]te[to.n] 
= [f{x{t, 0, e), umtelto,n] [d'"^''{s)Ulo,e], 

where <i"^^'P(s) is uniformly regular w.r.t. p, Sti, . . . ,Sti at s = 0, and 

1=1 



(7.10) 



St,. 



Using the inductive assumption for W2 = {Ti,Vi,T,Sti,St)i=i^i^^__^k with to = cind 
bo{s,p,Sti, . . .,Sti) = <''^(s), we get 



K^'^(^)]..[0,e][/(^(t,^,p),<(t))]teh,.] 

= [fixit, 0, e), n(t))],,[,,.]K-"'^'^(s)],,[o,,], 
where d"'^'"'^''P[s) is uniformly regular w.r.t. p, Sti and St at s = 0, and 

k 

d"i."2,P(o) = B^^Xd'^'m) + 5^^r., [f{x{r,),v,) - f{x{n),u{n)) 

1=1 

k 



(7.11) 



St, 



Sti. 



i=l 
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Multiplying dHO]) by [f{x{t,e,p),u^{t))]t^[r„r], using (JTH]), and taking := 

d"'^'"'^'P{s), we get the assertion. 

Situation 2.B. If all Tj are equal then either 

Ti = ...Tk = r or Ti = . . .Tk < T. 

2.B.I. In the first case using the assertion for tVi = (r^, Vi, 6ti, r, 6t — Stk)i=i^2,...,k-i we get 

[bo{t,s)]se[o,e][fi^it^^^P)^^Ti't))]te[to,r+{St-stM 

where di^'^{s) is uniformly regular w.r.t. p, 6ti, . . . , 6tk-i, St — 6tk at s = and 

fc+i 

dr'^(O) = BrtM0,p)) + {St-Stk)f{x{T),u{T)) + J2Brr, [f{x{T,),V,) - f {x{n) , u{n))] St,. 

1=1 

Now using Lemma 17.61 for to = t, c = 6t — 6tk, v{t) = Vk, p = {p, 6ti, . . . , 6tk-i, St — 6tk), 
and 6o('S,pO = d'^^'^{s) we get 



where d2^'^^'^^'"'^{s) is uniformly regular w.r.t. p, 6ti, . . . , 6tk, 6t at s = and 

a^rM,St.,P^Q^ = dr'^(O) - 6t,f{x{T,0,p),u{T)). 

Again multiplying (|7.11|) by [/(a;(r + 1, using (|7.13|) and taking 

= we get the assertion. 

2.B.I. If Ti = . . . = Tfc < r we can use the result from 2.B.1 for a symbol tVi = 
(Tj, Vi, 6ti, T = Tk, 6t = 0)j=i^...^fc_i and then use the inductive assumption for [to, r] = [r^, r] 
and tt)2 = (t, 5t) on [to = t^, t] in essentially the same way as in the case A. The inductive 
argument is now complete. 

Finally, to obtain the assertion for ti not r, one has just to proceed as in the step 1 
with 6t = and use Lemma [7.51 again, taking to = t, ti = ti, bo{s,p) to be the final-point 
A-homotopy d"''^{s) derived for ti = r, and the control v(t) = u{t) = + s6t). □ 

The set of infinitesimal variations " 

Remark 7.7. Observe that choosing bo{s) = in Theorem 17.41 we obtain an admissible 
path <i'^(s), regular at s = 0, defined for < s < 0, and satisfying 

Ht,£)]tG[to,h+e5t] = Ht)]te[to,t^][d'^{s)]se[o,s], (7.14) 

for e<e. 
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We define the set consisting of elements of the form ^""(0), where tv = {Ti, Vi, r, Sti, 5t)j=i,...,fc 
are symbols with r fixed: 

[ i=i 
- f{x{Ti),u{Ti)) 6ti : {Ti,Vi,T,6ti,6t)i=i^,„^k is a symbolj C A^^ti)- 

We will call the set of infinitesimal variations of the trajectory f{x(t), u{t)) associated 
with the regular r G (to,^i)- 

The set KJ^ can be interpreted as the set of all generalised directions in in which 

one can move the final base-point x{ti) by performing needle variations, associated with 
symbols to = {Ti,Vi,T,6ti,St)i=i^_^^^k with fixed r and trivial initial base-point variations 

Xo{s) = Xq. 

The geometry of K!^ will be an object of our main interests in Chapter O Now let us 
note the following property 

Lemma 7.8. The set is a convex cone in Ax(ti)- 

Proof. Take symbols ro = (r^, Wj, r, 5ti, 5t)i=i,...,A:, ^' = (t-, v[, r, 6t[, 5t')-^^ j^' and numbers 
v, v > 0. We have to find a symbol o such that 

Due to Remark 17.3^ we may change the symbol by adding (tj, Vi, 6ti = 0) without changing 
the variation u^. As we see from the form of ( I7.3p . such an addition will not change d"'(0). 
Consequently, we may assume that = /c , = , = f j, and the symbols tt) and to differ 
only by Sti and 6t. Now consider the symbol t) = (tj, Vi, r, uSti + u 5t^^ v5t + v 5 )i=i,...,fe. 
The formula (17. 3p (for bo(0,p) = 0) is linear with respect to 5ti and 5t, hence 

d\Q) = vd^{Q) + v'd}"' [Q). 

□ 

At the end of this chapter we define several geometric objects which will play an important 
role in Chapter O 

Consider the real line M with the canonical coordinate t G M. The tangent space T^R 
is spanned by the canonical vector dt- Denote by A^; the ray 



A^ := M+ ■ {-dt) C T^M, 

and by Xx the ray 

A^ := e^,®K^E^® T^R = A^, 
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where x = Finally define 

/C;' := conv {Bt.toiSo © K^^} , 

where So = $o(Tz(,5'o) was defined in Chapter[5l By Theorem I7.4[ JC^ has an interpretation 
of the set of all generalised directions in Ax{ti) in which one can move the final base-point 
x(ti) by performing needle variations, associated with symbols tt) = {Ti,Vi,T,6ti,6t)i=i^^^^^k 
with fixed r and initial base-point variations in the directions of Sq © %(to)- 



Chapter 8 



Technical lemmas 



In this chapter we prove two technical results about £'-homotopies — Lemmas I8.1l and l8.2[ 
which will be crucial in the proof of Theorems 15.11 and 15.41 To discuss briefly the results, 
given a family of smooth curves : J — ?■ M"^, parameterized by r G B"^{0, 1) C M™, 
which emerges from a single point x^(0) = and points into every direction i:^(0) = r, 
it is quite obvious that, for every t > small enough, there exists a curve Xfo from this 
family which reaches at time t. A similar result holds for families of admissible curves 
on a skew-algebroid E. Any such family which is sufficiently regular and emerges from a 
single point into every direction in E will realise a zero homotopy class. This is Lemma 
18.11 In Lemma 18.21 we prove that two sufficiently regular families of admissible paths in 
E emerging from a single point must have a nonempty intersection of homotopy classes, 
provided that the set of their initial (generalized) velocities is rich enough. 

These results seem to be quite natural and they are indeed, if such an algebroid is 
(locally) integrable. In this case i?-homotopy classes can be represented by points on a 
finite-dimensional manifold. However, if E is not integrable, E'-homotopy is just a relation 
in the space of bounded measurable curves. Therefore to prove the results we have to pass 
through the Banach space setting. The main idea in the proof is to semi-parametrise 
the ii^-homotopy classes by a finite dimensional-space and reduce the problem to a finite- 
dimensional topological problem. By a semi-parametrisation we mean an epimorphism 
from a finite- dimensional space to the space of i?-homotopy classes. 



Local coordinates 

Since we are going to work in a Banach space setting it is convenient to introduce local 
coordinates on an algebroid E. Consider coordinates (x",?/*) G t/ x M"^ C M" x M."^ 
trivialising the bundle t : E M around a point p G M. We may assume that p 
corresponds to G f/. As usual, we will denote the structural functions of E in these 
coordinates by p^(x) and c*;j.(x). Since these functions are smooth, we can assume (after 
restricting ourselves to a compact neighborhood V 3 in M") that they are bounded 
(by numbers Cp and Cc, respectively) and Lipschitz w.r.t. x*^ (with constants Lp and Lc, 
respectively). It will be convenient to think of V x R'" with those functions as of a (local) 
AL algebroid. Observe that every bounded measurable E-path with the base initial-point 
p is represented by a pair of paths (x(t), a{t)) G R" xR"*, where a{t) is bounded measurable 
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and x(t) is an AC-solution of the ODE 

x\0) = 0. 

As we see, x{t) is determined entirely by a{t). We can thus identify the space AVAip{I, E) 
of bounded measurable admissible paths originated at p with the space BM.{I ,W^) of 
bounded measurable maps a : I ^ R™. We will consequently speak of algebroid homotopy 
classes in BM.{I ^W^). Note that BM.{I ,W^), equipped with the L^-norm, is a Banach 
space. We will denote this norm simply by || ■ ||. The same symbol will be also used for 
L^-norm in W^. In our considerations we will understand a product of Banach spaces 
and (i32,||-||2) 

as a space Bi x B2 equipped with the norm ||-|| — Il'l|i~l"||'|l2- 

First lemma 

Lemma 8.1. Let af^(-) E BM.{I,BJ^), where f E -B'"(0, 1), be a family of E -paths uni- 
formly regular at t = w.r.t. f and such that a^(0) = r. Then there exists a number 77 > 
with the following property. For every < e < rj there exists a vector such that the 
curve afg(t), after restricting to the interval [0,e], is null-E-homotopic: 

KW],,[o,.]= [0]. 

Let us briefly sketch the strategy of the proof. Denote by c,=- a constant path c,=-(s) = r 
in M."^. We will construct a continuous and invertible (local) map of Banach spaces $ : 
R"* X B — > BAi{I, R™) (the space B will be specified later) which will have an additional 
property that the homotopy class of the image is determined by the first factor only 

mr,d)] = [c,]. 

In such a way we will realise our idea from the introduction to this chapter — R*" 
will semi-parametrise all local E'-homotopy classes of AVAip{I, E). Next, using the map 
a : r I— )■ a,^, we will construct a continuous map of finite-dimensional spaces 

j^m ^ ^m^Q^ ^ BM{[0, 1],R'") ^ R'" X i3 ^ R*". 

A topological argument will prove that lies in the image of this map, hence 

[a^o] = [cq] = [0] for some 1%. 

Proof. Consider an E'-path with a constant R"*-part a{t) = f, where r is a fixed element 
in R™", t E [0, 1]. The associated base path x{t) E MJ" is the solution of 



(d,x''it)=p1ixit))a\t)=p1{xit)y, 
\ a;^(0) = 0. 



(8.1) 
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Clearly, if ||r|| is small enough, the solution of this equation exists for t G [0, 1] and is 
contained entirely in V C M". Now for a{t) and x{t) as above and fixed paths d G 
i3A^(/, M™), b G AC{I,W^), consider the following system of differential equations: 

dsa'it, s) = d\t) + 4fc(x(t, s))a^{t, s)h\t), 

a%t,0) = a\t) = r\ 
dsx\t,s) = p1{x{t,s))b\t), 
x\t,0) = x\t). 

The existence and regularity of the solutions of fl8.2p can be discussed using the theory 
developed in Appendix IB. 21 Let us concentrate first on the equation for x{t, s). The right 
hand-side of this equation is AC in t and Lipschitz in x, the initial value depends AC on 
a parameter t, and hence, by the standard theory of ODEs, the solution x(t, s) is defined 
locally and is AC w.r.t. both variables. By shrinking the norm ||fe||sup we may change 
the Lipschitz constant in the defining equation. Consequently, for ||&||sup (and ||?^|) small 
enough, the solution x{t, s) is defined for all t, s G [0, 1] and entirely contained in V. 

Now the right hand-side of the first equation in (18.21) is locally Lipschitz w.r.t. a and 
bounded measurable w.r.t. the parameter t. The initial value a*(t, 0) depends continuously 
on t, hence, by Theorem IB.13t the solution a{t, s) locally exists, is AC w.r.t. s, and 
is bounded measurable w.r.t. t. Again, shrinking ||6||sup makes the Lipschitz constant 
smaller, hence for ||&||sup small enough a{t, s) is defined for all t, s G [0, 1]. 

Now let us consider (18. 2 p with b{t) = (i(s)ds, where d is chosen in such a way, that 
b{0) = 6(1) = 0. We have 



dsa\t, s) = dtb\t) + c},(x(t, s))a^{t, s)b\t), 
dsx\t,s) = p\{x{t,s))b\t). 



(8.3) 



We recognise equations (13. 2 p for i?-homotopy. Indeed, in such a situation a(t, s) and 
b{t,s) = b{t) form an E'-homotopy with fixed end-points (since 6(0) = 6(1) = 0). Conse- 
quently, the homotopy classes of a(t, 0) = c^{t) and a(t, 1) are equal. Since ||6||sup < \\d\\, 
for \\d\\ and ||r|| small enough, this homotopy is defined for all t, s G [0,1]. For a{t) and 
d{t) as above we define 

$(f,c/)(t) := a(t, 1). 
This is a (local) map of Banach spaces 

where BMq{I,W) = {d G BM{I,W^) : d{s)ds = 0} is a Banach subspace of 
i3A^(/,]R™) and Wq is some open neighbourhood of the point (0,0). We shall now prove 
the following: 

(A) $ maps (f, 0) into a constant path G BM{I,W^). 

(B) $ is a continuous map of Banach spaces. 
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(C) The iJ-homotopy class of the curve $(r*, d) is determined by r; that is, 

[$(f,rf)] = [<|.(f,0)] [c^]. 

(D) The map $(r, d) := $(r, d) — {cp+ d) is Lipschitz with constant |. 

(E) The map $ posses a continuous inverse defined on some open neighbourhood 

Vq3Q in BM{I ,W^). Moreover, is Lipschitz with constant 6. 

Property (C) is clear from the construction of $, as a(t, 1) = $(r, and a(t, 0) = 
cr{t) are E'-homotopic. 

Property (A) is obvious, since $(r, 0) is the solution (taken at s = 1) of the differential 
equation dsa{t, s) = with the initial condition a(t, 0) = r. 

Property (B) will follow from (D). Indeed, if $ is Lipschitz, then ^{r,d) = $(r*, d) + 
+ d is continuous as a sum of continuous maps. 

Assuming (D) again, we will be able to prove (E). As one might have expected, the 
existence and the Lipschitz condition for will be proven essentially in the same way 
as in the standard proof of the inverse function theorem (cf. [Lang, 1985| ). First, we will 
establish a pair of linear isomorphism between Banach spaces 

a{t) I — > i^j a(s)ds, a{t) — j a(s)ds 
and 

(r, d) I — )■ + d. 

It is straightforward to verify that a and /3 are continuous inverses of each other and 
that a is Lipschitz with constant 3. The map $ is defined on some open neighbourhood 
Wq 3 (0,0). Take R such that B{0,2R) C Wq. The map $ is Lipschitz with constant | 
and a is Lipschitz with constant 3; hence a o $ is Lipschitz with constant ^ and, since it 
preserves the origin, it maps the ball B{0, 2R) into the ball 5(0, R). 

Fix now any a G BAi{I, M™") such that ||a|| < j. We shall construct a unique element 

(f, d) e 5(0, 2R) C Wq satisfying $(r, d) = a. Consider a map $a(^, d) := a{a — $(r, d)). 
From the Lipschitzity of a and $ we deduce that 

||$a(r,rf)|| <3||a-$(f,rf)|| <3||a||+3||$(r,rf)|| <3-| + ^||(f,rf)||. 
Consequently, maps the ball B{0,2R) into 5(0,2/2). Moreover, 

||$,(f,rf)-$,(r-',rf')|| = ||a(a-$(f,rf))-«(a-$(r-',rf'))|| < 

< 3||$(f,d) - W,d')\\ < 3 ■ ^||(f,rf) - (r-^,rf')||. 
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hence $a is a contraction. Now, using the Banach fixed point theorem, we deduce that $a 
has a unique fixed point (r, (i) G 5(0,2/?). Consequently, 

a - $(f, (i) = /3 o a - $(f, d) j = /3 o <|)„(r, c?) = /3(f, c?) = (i, 

and hence a = ^{f, d) + Cf^ + d = ^{f, d). We have proven the existence of 

Take now a, a' G and let ^-\a) = {f,d), ^~\a') = {r,d'). Using the 

Lipschitz condition for a and $ once more, we get 

\\{f,d)-if',d')\\ = \\<^air,d)-<!>Ar,d')\\ = ||a(a - $(f, d)) - «(a' - $(r-', rf')) || < 

< 3||a-a'|| +3||$(f,d) -$(r < 3\\a - a \\ + 3 ■ l\\{f,d) - (r ,d')\\. 

6 

We finish the proof of property (E) concluding that 

||$-i(a) -$-^(a')|| = \\{f,d)-{r,d')\\ <6||a-a'||. 

We are now left with the proof of (D). This will be done by introducing several integral 
estimations. In our calculations we will, for simplicity, omit the indices (hence c will stand 
for c*fc, a for a\ etc.). Take pairs (r, d) and {r\d') from x BMo{I ,M!^). Denote by 
x(t, s), a(t, s), a{t), b(t) and x'(t, s), a'{t,s), a'(t), b'{t), respectively, the objects defined 
as in the construction of $ for pairs {f,d) and (r,d'). To begin with, observe that, since 
b{t) = Jq (i(s)ds, we have \b{t)\ < \d{s)\ds; hence 



I sup 



< 



Similarly, ||&'||sup < \\d'\\ and ||& — &'||sup < — 

Let us now estimate the difference \x{t, s) — x (t, s)\. Since, by (18.31) . x{t, s) = x{t) + 
Jq p{x(t,a))b{t)da, we have 



\x{t, s) — X (t, s)\ 



< 



< 



p{x{t, a))b{t) - p{x' (t, a))b' (t) ) da 



pixit,s))b{t)-p{x'{t,s))b'it) 



< 



pixit,s))-pix'it,s)))bit) 



ds < 
ds+ 



+ 



pix'it,s)){bit)-b'it) 



< Lp sup \x{t, s) — X {t, s 

it,s) 



ds < 



Cp\\d — d \\. 



It follows that 



sup \x{t, s) - x'{t, s)\(l- Lp\\d\\) < Cp\\d - d' \ 
(t,s) V / 
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For \\d\\ sufficiently small (in other words, after a possible shrinking of Wo) we will obtain 

sup|x(t,s) -x'{t,s)\ < 2Cp\\d- d'\\. (8.4) 

it,s) 

Now introduce 

Sa(t, s) := a(t, s) — (a(t) + sd(t)) and 
Sa {t, s) := a (t, s) — (a (t) + sd (t)). 

Note that Sa{t,l) = $(f, d) and Sa'{t,l) = ^{r ,d'). From (18. 2p we deduce that 

Sa{t,s) = J c{x{t, a))a(t, a)b(t)da = J c{x{t,a))(^6a(t,a) + a{t) + ad{t)Jb{t)da. 
Further, for a fixed s G [0, 1], 



pi pi ps 

I \5a{t,s)\dt< / / 
Jo Jo 



c{x{t, a))(Sa{t, a) + a{t) + ad{t))b{t) 



dadt < 



1 rl 



< 




C,{\6a{t,s)\ + M + \d{t)\)\\b\Updsdt< 
sup (^sup Pa(-,s)|| + ||f|| + 
<CJd|| (sup||5a(-,^)ll + lk1M 



'0 JO 



< 



and we conclude that 

sup||5a(-,.)||(l-CJrf||)<a(||f|| + ||d||). 

s 

Hence, for \\d\\ small enough (after possible shrinking of Wq), we get 

sup||5a(-,s)ll <2Ce(||r|H 

s 

Finally, 

\\5a{-,s) - 5a{-,s)\\= [ \6a{t, s) - 6a' {t, s)\dt < 



(8.5) 



1 rs 



< 




JO 



c{x{t,s))(Sa{t,a) + a{t) + ad{t))b{t) + 



- c{x'{t, a)) (^5a{t, a) + a (t) + ad' (t)^ b' (t) 



dadt < 



1 rl 



< 




c{x{t, a))6a(t, s)b{t) — c{x {t, s))Sa {t, s)b (t) 



'0 ^0 

•1 rl 



dsdt- 



+ 




Jo 
1 rl 



JO 



c{x{t,s))a{t)b{t) - c{x' (t, s))a' {t)b' (t) 
c(x(t, s))d{t)b{t) - c{x'{t, s))d' {t)b' (t) 



dsdt+ 

dsdt =: h + l2 + h 
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Now we estimate 

•1 rl 



h < 




'0 ^0 

•1 rl 



+ 



+ 




c(x(t, s)) - c(x (t, s)) \6a{t, s) \\b{t)\dtds+ 
c{x'{t,s)) 6a{t,s) - 6a'{t,s) \b{t)\dtds+ 



'0 JO 

• 1 rl 




^0 



c{x'{t,s)) 6a\t,s) b{t)-b'{t) 



< Lc sup \x{t, s) — X {t, s) \ sup \\Sa{-, s) 

{t,s) 

+ C,snp\\6a{;s)\\-\\b-b' 



dtds < 

sup + Ccsup \\Sa{-, s) - 6a\-, s) 



I sup 



+ 



I sup • 



Finally, using ([831), (D and 



I sup 



< 



we get 



h < L,2CM - d ||2Ce(||rl + + C.sup ||5a(-, s) - 6a (-, s)\\ ■ \\d\\ + C,2C,{\\f 

s 

+ - d'll = CelMII sup ||<5a(^ s) - (5a\^ + ||d - ^i(lklMMIMk'll 



-I I 



where Fi converges to when its arguments do. Similar estimations for I2 and will give 

l2< (||r-r'|| + ||d-d'||)-F2(||r||,||rf||,||r'||,||rf'||), 
/3< (||r-r'|| + ||d-d'||)-F3(||r||,||rf||,||r'|U|d'||), 

where F2 and F3 behave as Fi. Putting together the partial results, we would get 

sup \\da{; s) - 6a {; s)\\{l - 2CM) < (||r - r'|| + ||d - ■ F (||r||, ||r'||, ||c/'||) , 

where F converges to when its arguments do. As $(r, c?) = 6a(t,l) and $(r',(i') = 
6a' {t, 1), for Wo small enough, <I> is Lipschitz with constant |. That proves property (D). 

Now using properties (A)-(E) of $ we will make the final step of the proof of Lemma 
18.11 The family a^(t) is uniformly regular w.r.t. r G -B (0, 1) at t = 0. The family Cff{t) 
has the same properties, so a^(t) — c^f(t) is also uniformly regular (cf. Proposition IB.8P 
and ^ 

/ \aris) - Cris)\ds = t|a,-(0) - c,-(0)| + f{t,r} =t-0 + f{t,r}, 
Jo 

where jf(t,r) converges uniformly to as t — )■ 0. Hence, there exists a number rj > 
such that 

r 1 

J |a^-(s) - Cj^{s)\ds < —e, 

for every < 5 < 77 and r G 5™(0, 1). Reparametrising the paths by the rule 

a^(t) := ea^(et). 
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we will obtain another uniformly regular family of paths satisfying a^(0) = sr. 

By the uniform regularity of a,?, the map a : rH- is a continuous map from i?™'(0, 1) 
to BM.{I^ W^) with Li-topology. For rj small enough a takes values in ^{Wq). Composing 
a with we will obtain a continuous map 



Observe that 



5^(0, 1) ^ X BM,{I, 



i \ea^{te) — ecp{te)\(it = j |a^(t) — c^(t)|dt < -^e. 



Using this, the Lipschitz condition for $ ^ (property (E)), and the fact that $ ^(cr) = 
(r, 0) (property (A)), we obtain 

1111 6 1 

\\-^{f)-r\\ < -||^(r)-erl + -||0(r)-O|| = - ^^\c,^r)\\ < -||ar-c,HI < t^- 

In other words, ip := '^ip maps a ball i?'"(0, 1) continuously into M™ in such a way that 

\\iP{t) ~ r\\ < \- By Lemma lD.71 point G M'" lies in the image of ip. However, that 
means that ^/'(ro) = for some ro, and hence Hf^ = $(0, d) for some d G BAio{I, M™'). By 
property (C), [aro]te[oi] — 0- Finally, by Lemma [3. 171 

= [aro(^)]tG[0,l] ^ ['^n)(^)]tG[0,£] ' 

which finishes the proof. □ 



Second lemma 

We will now formulate and prove a result generalising Lemma 18.11 We will work in the 
same local setting as before. Let us introduce a decomposition = M™^ © M'"^ and fix 
ko e W. 

Lemma 8.2. Let a^(-) G BM{I,R^), where f G B'"i(0, 1) © Om^, be a family of E -paths 
uniformly regular at t = w.r.t. f and such that a^(0) = f+ ko. Let bg{-) G BAi{I, R"^), 
where s G 6mi © -B™^(0, 1), be a family of E -paths uniformly regular at t = w.r.t. s and 
such that bg{0) = s + /cq- 

Then there exists a number rj > such that, for every < s < f], there exists vectors 
fo and sq ensuring that the curves a^o(t) and bg^lt), after restricting to the interval [0,e], 
realise the same E-homotopy class 

ko(^)]te[o,.] = [hMtmeV 

Proof. We will follow the scheme of the final part of the proof of Lemma 18. H making 
extensive use of the map $ : M™ x BMq{I, W^) ^Wq^ ^{Wq) C BM (/, M™) constructed 
before. 
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By the uniform regularity of the famihes a,?, bg, and c^; there exists a number rj > 
such that, for < e < ?7, 

r 1 

J \ar{t) - c.^^^ {t)\dt < —e, for every f G fi"^ (0, 1) © 6^^ and 

IM^) - Cg^ko(t)\dt < ^e, for every s G © 5™^(0, 1). 





Now let us reparametrise the paths a^^ and bg by the rule 

a^?(t) := eaff{et) and 

bg{t) := ebg{et) for tG [0,1]. 

We obtained another uniformly regular families of i?-paths satisfying a^(0) = e{r + k^) 

and bg{0) = e{s + ko). Moreover, - c^(^+fc,j)|| < ^£ and \\bg - c^^g+j:^)\\ < and since 

7] can be chosen arbitrary small, we may assume that a^? and bg belong to $(Vro) for all r 
and s. 

By the uniform regularity of and bg, the maps H : r ^ 71^ and b : s ^ bg are 
continuous maps form 5™i(0, 1) © 6'„2 and 9^^ © 5™2(0, 1), respectively, to BM{I,W^) 
with Li-topology. Composing them with <l>~^ we will obtain continuous maps 

5"*! (0, 1) © 6^^ ^^^^^ W X BMo{I, K"*) and 
© 5'"2(0, 1) ^^^^ M™ X BMo{I, M™). 

Now, using the Lipschitz condition for and the fact that $~^(cr=-) = (r, 0), we can 
estimate in a way analogous as in the proof of Lemma [8.11 that 

II - {f+ 4)11 <l for f G ^'"^(0, 1) © 9m, and 

\\^^jJ,{g)-(s + ko)\\<^ for sG^^, ©S'"^(0,1). 

By Lemma ID. 81 the images of the maps ^ipa and ^ipi, have a nonempty intersection. In 
other words, there exist fo and So, vector R G M™, and da,db G i3A^o(-^5 1^™) such that 
= ^{R,da) and bgg = ^{R,db)- By property (C), the £^-homotopy classes of a^^^ and 
bgQ are equal. Consequently, by Lemma 13.171 

[ajx,{'t)]te[0,e] = [^n)(^)]te[0,l] ^ ^so(^) ^ No (^)]tG[0,e] ' 

L -I tG[U,lJ 

which finishes the proof. □ 



Chapter 9 



The proof of the PMP 



In this chapter we wih finish the proof of Theorems 15.31 and 15.41 In our considerations it 
is crucial to understand the geometry of the cone 1^'" of infinitesimal variations along the 
optimal trajectory f{x{t),u{t)). We interpreted as the set of all directions in Ax(ti) 
in which one can move the point x{ti) by performing needle variations of the control u 
associated with symbols tn = {Ti,Vi,T,6ti,6t)i=i^,,,^k, where r is fixed. Consequently, a 
movement in the direction of the ray 

^x(ti) '■= Sx{ti) © IR+ ■ (—dt) C Ex(ti) © T^(ti)IR = Ax(tj) 

would correspond to a variation which decreases the total cost of the trajectory without 
making changes in the E'-evolution. Such a behaviour should not be possible if f{x{t),u{t)) 
is a solution of the OCP (jP]), so we may expect that the ray Ax(ti) can be separated from 
the cone KJ^ in such a case. This result is formulated in Theorem 19.11 In the proof we 
use technical Lemma [8. II to deduce the existence of E'-paths realising certain i?-homotopy 
classes from the infinitesimal picture expressed in the language of the cone K"!^ and the 
ray Ax{ti)- When Theorem 19.11 is proved, to finish the proof of Theorem 15.31 we need 
only to follow a few rather technical steps from the original proof of Pontryagin and his 
collaborators [Pontryagin et ai, 1962| . 

Theorem 15.41 is proven analogously with some technical modifications. The main dif- 
ference is that instead of KJf we use a bigger set /C" which contains information about 
both needle variations and initial variations of a given trajectory. Using technical Lemma 
I8.2l we prove Theorem 19.61 describing the geometry of /C". Then, basing on this result, we 
make a few final steps after [Pontryagin et ai, 1962 . 



9.1 The proof of Theorem 15.3 



The geometry of the cone 1^" 

Throughout this section we assume that the controlled pair {x(t),u(t)) is a solution of the 
OCP (jP]). All results obtained in this section are valid under this assumption. 

Theorem 9.1. Let {x{t),u{t)) , fort G [to;^i]; be a solution of the optimal control problem 
(jPj) . Then the ray A^^ti) o-nd the convex cone KJ^ can be separated for any r G (to,^i)j 
which is a regular point ofu. 
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The idea of the proof is the following. Assuming the contrary we will construct a 
family of symbols rD(r), where r G -Ex(ti); such that the associated infinitesimal variations 
d^^'^(s) are uniformly regular w.r.t. r at s = and point into the directions r — dt ^ 
Ex{ti) ffi Ta;(j^)]R = For such a family we will be able to use Lemma [8.11 to deduce 

that for some tq the variation cr°^'^°\s) has special properties. Next we will show that in 
such a case the pair {x{t), u{t)) cannot be a solution of the OCP flPj) . 

Proof. Assume the contrary, i.e., that the convex cone and the ray Ax(ti) cannot be 
separated. Denote by A := ^'^.(tj) — 9t G Ex(ti)®Tx(ti)^ a vector spanning Ax[ti)- It follows 
from Lemma [p. 61 that there exists a basis {ci, . . . , Bm} of Ex{ti) ®dx(ti) C Ax{ti_) such that 
vectors A, A + e^, A — lie in Klf: for z = 1, . . . , m. 

Denote by ro, roj, and Oj some symbols such that elements in corresponding to 
these symbols are d"'(0) = A, d"''(0) = A + Cj, and = A — Cj, respectively. We 

deal with a finite set of symbols, hence we can assume that they all are of the form 
(tj, Wj, r, 5ti, 5t)i=i,...,A:, where Tj, Wj, k, and r are fixed, and that they differ by 5ti and 5t 
(we can always add a triple (xj, t'j, 5ti = 0) to a symbol without changing anything — cf. 
Remark 17. 3p . For any r = Xli^i ^^^i ^ i?"*(0, 1) = {r : ||r|| = |rj| < 1} we may define 
a new symbol 

n,(r)= (1-5^ 
\ j=l 

where h^{r) = max{r, 0} and h~{r) = max{— r, 0} are non-negative, and the convex 
combination of symbols is defined using the natural rule 

z/(ri, Vi, T, 6ti, 5t)i=i,...,fe + fi{Ti, Vi, T, St'i, 5t')i=i,...,fc 
= (Tj, Vi, T, u6ti + fi6t[, u6t + /i5t')i=i,...,fc . 

We will now study the properties of A-paths s cr°^^(s) corresponding to symbols lti(r*) 
(see Remark . 

From (17. 3p it is straightforward to verify that 




d«(^T(0) = A + f. 



If follows from Theorem 17.41 that, since the numbers 6t(f) and 5ti{r) in the symbol 
rD(r) depend continuously on r, which takes values in a compact set, we may choose 6* > 
such that d'°^^{s) is well-defined for s G [0, 9] and all f G 5™(0, 1), 

Now consider (f''^'^\s) — the projections of the family of A-paths d}°^'^\s) to the al- 
gebroid TM. Observe that since d^^'^\s) are uniformly regular, so are (^^^'^\s). Since in 
canonical coordinates on TM we have d"'*-'^(0) = —1, there exist a number < r] < 9 such 
that ^ 

' d"('^(s)ds < (9.1) 







for all e < ?7 and all r G 5™(0, 1). This property will be used later. 
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After projecting d^^^{s) from A onto E, we obtain a family of bounded measurable 
admissible paths d^^'^(s), again uniformly regular at s = w.r.t. r G -B™'(0, 1) C M™", 
and such that (i'"(^)(0) = r e ^ -E'x(ti)- In other words, the paths satisfy the 

assumptions of Lemma [8.11 and, consequently, there exists a vector r'o G i?™(0, 1) and a 
number < e < r] such that 

[^"'^'°H^)]..[o.e] = [0]- (9-2) 

Properties fl9.ip and (19. 2p contradict the optimality of f{x{t),u{t)). Indeed, from 
fl7.14p we know that f{x{t,s),Us{t)) — the variation of the trajectory f{x{t),u[t)) asso- 
ciated with a needle variation (t) := v!I^''"\t) satisfies 



Projecting the above equality to the algebroid E and using f l9.2p we get 

and hence the i?-homotopy classes agree. 
What is more, the TM-projection gives 

From (19. ip we deduce that the total costs satisfy the following inequality: 

j-t\+£5t{fo) fti re 

x{h + e5t{fo),e)= / L{x{s,e),u,{s))ds = / L{x{s),u{s))ds + / d"'^''°\s)ds 

Jto Jto Jo 



< / L{x{s),u{s))ds = x{ti). 



to 



The above inequality proves that f{x{t),u{t)) cannot be a solution of the OCP ( |P| . which 
stays in a contradiction to our assumptions. □ 



To finish the proof of Theorem 15.31 we will now follow the steps of the original result 
of [Pontryagin et ai, 1962 . All the important information is contained in Theorem 17.41 
telling us that the set of infinitesimal variations is a convex cone with elements defined 
by means of a local one-parameter group (see (17. 3p ) and in Theorem 19.11 describing 
the geometry of this cone. The structure of an AL algebroid, necessary to prove the above 
results, will now play no essential role. 



The construction of ^(t) and the "maximum principle" 

Fix an element r G (to7^i) to be a regular point of u. In view of Theorem 19 . 1 1 there exists 
a non-zero covector G ^^((^) separating iC" and Ax(ti)', that is (confront Remark 

{d, |(ti)>^ < < (A, ^(ti))^ for every d G K^. (9.3) 
Let us define ^(t) := B*^(£(ti)) G A* for t G [to,ti]. 
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Lemma 9.2. For every t G [to? t] which is a regular point of the control u(t) the following 
"maximum principle" holds: 

H{x{t),${t),u{t)) = sup H{x{t),${t),v). 
Moreover, H{x{t), $,{t),u{t)) = 0. 

Proof. Choose a regular point t G [^0)^]; take an arbitrary element v & U and a number 
6ti > 0, and consider a symbol ro = (ti = t,6ti,Vi = v,T,St = 0). The corresponding 
element d"(0) G K:^ equals Bt^t[f{x{t),v) - f{x{t),u{t))]6ti (cf. 1^). From ([SSD we 
obtain 

> (BtMi^it), v) - f{x{t), u{t))], 

= {f{x{t),v) - f{x{t),u{t)),m)jh 

H{x{t),^{t),v) - H{x{t), m.<t)))6t^. 



Since 6ti > 0, we have H{x{t),^{t),v) < H{x(t),$,{t),u(t)) for arbitrarily chosen f G f/. 

To prove the second part of the assertion, consider a symbol = (r, 6t). The associated 
element ^"(0) is Bt^j. {f{x{T),u{T)))5t G X". Consequently, from (19.31) . we obtain 

0>(A..(/(^c(r),w(r))),^(ti)>/t 

^'"=^ n(r)), ^(r)>/t = ff (x(r), |(r), n(r))5t. 

Since 6t can be arbitrary, we deduce that H{x{t),^{t),u{t)) = 0. □ 



The condition H{x{t), ^{t),u{t)) = 

To finish the proof just two more things are left. We have to check that the Hamiltonian 
H {x(t) , $,(t) , u{t)) is constantly along the optimal trajectory, and we have to extend the 
"maximum principle" to all regular t G [to7^i] (so far it holds only on the interval [toi''"]) 
where r < ti is a fixed regular point). 

Lemma 9.3. For ^{t) defined as above, the equality H[x{t), ^{t),u{t)) = holds at every 
regular point t G [to, r] of the control u. 

Proof. Denote by P the closure of the set {u{t) : t G [to,T]}. Since u{t) is bounded, P is 
a compact subset of U . Define a new function m : A* — > M by the formula 

m(a:;,^) := max i3"(a:;, ^, t;). 

It follows from the previous lemma that m(£c(t), $,{t)) = H{x(t), ^{t),u{t)) at every regular 
point t of u. We shall show that m{x(t), ^(t)) is constant on [to)T]j and hence equals 
H{x{t), ^(t),u{t)) = (confront Lemma 19^ . Observe that the function H (x(t) , ^(t) , v) 



9.1. THE PROOF OF THEOREM 5.3 



77 



is uniformly (for all f G P) Lipschitz w.r.t. t. Indeed, in local coordinates x, y*, y) on A 
and on A* we have ff ^(t), = ^^(t)/* +{L(x(t), v). Note that, 

by assumption, functions /'(x, f) and L{x,v) are w.r.t. x and their x-derivatives are 
continuous functions of both variables. Since x{t) is an AC path with bounded derivative, 
functions ^{x{t),v) and ■^[x{t),v), as well as functions /*(x(t),f) and L{x{t),v), are 
bounded in [to, t] x P. As the evolution of C,{t) is governed by fl4.7p and u{t) is bounded 
on [to,'?"], the derivatives dt^^(t) are also bounded on [to, 7"]- Consequently, since the path 
(ic(t),^(t)) G A* can be covered by a finite number of coordinate charts, the t-derivative 
of H {x{t),^{t),v) is bounded on [to,r] x P. As a result there exists a number C such 
that 

Hix{t), ^{t),v) - H{x{t), ^it),v) < C\t - t I 



for all t, t' G [tp, r] and for any v E P. Observe also that 

d_ 

dt' 



{x{t),^{t),v) = dS{t)f\x{t),u{t)) + 



-pt (x) ( ^ (x, «(t)) ut) + ^ (x, «(t)) ) + 4 (x) f (x, u{t)) ut) 



r{x,u{t)) 



+ W^(x(t), «(t))p^(x)/^x(t), «(t)) + ^—ixit),uit))ptix)f\xit),uit)) 



Ut)cUx)r{xit),u{t))f{x{t),u{t)) 



by the skew-symmetry of c^j(x). 

Now take any regular points t, t' G [to,T]. Since u{t),u{t') G P, we have 

-C|t-t'| < if(a;(t),^(t),n(t')) - Hixit),^{t),u{t)) 
<m(a;(t),^(t))-m(a;(t'),^(t')) 
= //(a^(t),|(t),n(t)) - H{x{t),^{t),u{t)) 
< H{x{t),m,^^it)) - Hixit),at),uit)) < C\t-t\; 

i.e., m(a;(t), .^(t)) satisfies the Lipschitz condition on the set of regular points (dense in 
[to,T]). It is also a continuous map (since x(t) and ^(t) are AC and the maps L{x,v), 
f{x,v) are continuous in both variables), therefore it is Lipschitz on the whole interval 
[to,T]. By Rademacher's theorem, m(a;(t), ^(t)) is almost everywhere differentiable on 
[to,r]. Now take any point t of differentiability of xn{x{t), ^{t)) which is also a point of 
the regularity of the control u. We have 

m(a^(t'),|(t')) -m(a;(t),^(t)) > H{x{t'),0),u{t)) - H{x{t),m,u{t))- 
For t' > t, we get 

m{x{t'),^{t')) - m{x{t), m) ^ Hixjt'), |(t'), ^(t)) - Hixjt), |(t), n(t)) 
t' - 1 ~ t' - 1 
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Consequently, 

Similarly, for t' < t, we would get ^ra{x{t) , ^{t)) < 0. We deduce that ^m(a:;(t), ^(t)) = 
a.e. in [to,'?"]; hence m{x(t),$,(t)) is constant and equals H{x{t), ^{t),u{t)) = 0. □ 

Extending the "maximum principle" to [^o, ^i] 
Lemma 9.4. Let t G [to, t] he any regular point of the control u. Then 

C cl [K:^) . 

Proof. Consider an element d G K"^ of the form 



d = Bt^i[f{x{t),u{tmt + Y,Bt,Jf{x{n),Vi) - f{x{Ti),u{T,)) 



St,. 



i=l 



Since cl (-K'") is a convex cone it is enough to show that Bt^t{f{x{t)^u{t))5t) and 
Yfi=i Btin [/(*(Ti),^i) - f{x{Ti),u{Ti))] 6ti belong to cl (KJ^). The later clearly belongs 
to K!^ C cl(K^) since Ti<t <r. 

Assume now that Sj^j [f{x{t),u{t))6t] does not belong to cl(li'"). Since this set is 
a closed convex cone, by Theorem \D.2\ there exists a covector ^(ti) G ^^(j^) strictly 
separating cl (K"") from {Bt^t {f{x{t),u{t))6t)}; i.e., 

(d,|(ti)>^ < < {Bt,t {f{x{t), u{t))6t) ,?(ti)>, for any d G c1(K;^). 

Define |(t) := Lemmas and lOl hold for l(t) (we needed only (c?,|(ti)) < 

for d G -fC^ C cl(l^") in the proofs), hence, in particular, 

(/(a^(t),n(t)),|(t)>^ = H{x{t),^{t),u{t)) = 0, 

as t is a regular point of u. On the other hand, 

< {Bt4f{xit),uit))dt),${t^))^ = {fixit),u{t)),^it))jt = Hixit),'iit),uit))5t, 

and hence H{x{t),$,{t),u{t)) ^ 0. This contradiction finishes the proof. □ 

Note that, so far, we could define the set JC" only for a regular point r < ti. With 
the help of the above lemma we can also define K^^ as the direct limit of the increasing 
family of sets cl (-K""), 

K« := U cl . 

T<ti, T regular 

It is clear that K^_^ is a convex cone in Ax{ti)- It has geometric properties analogous to 
the properties of described in Theorem 19.11 

Lemma 9.5. The ray Ax[ti) o-nd the convex cone K^^ are separable. 
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Proof. Assume the contrary. By Lemma ID. 61 (we use it for V = A3.(t^) = © M = 
Ex{ti) © T^(ti)IR5 Ki = K^_^, S = {0} C W, and K2 = ^x(ti)), there exists a vector 
k e K^^ n Aa,(j^) and vectors Ci, . . . , G -^x(ti) such that (10.30 and (1D.4P hold. Since K^^ 



is a hmit of an increasing family of sets, there exists a regular t <ti such that (1D.3P and 



flD.4|) hold for i^i = c\{K^). In other words, Aa;(tj) and cl (1^") are not separable. By 



Lemma [D.3I also Aa,(fi) and K'^ are not separable. This contradicts Theorem 19.11 □ 

Now choose a non-zero covector ^(ti) G ^^(j^) separating X""^ and ^.^(ti) and define 
|(t):=S*^(^(ti)). Wehave 

(d,^(ti)>^ < < (A,|(ti)>, for every d G K,';. 

Since, by construction, C -K't", the covector ^(ti) separates also and Aa;(tj). This 
is enough for Lemmas 19.21 and 19.31 to hold for ^(t). As a consequence, for every regular 
point of the control m, we have 

H{x{t), m.u{t)) = sup H{x{t), $,{t),v) = . 

Finally, since (A, ^(ti)) > 0, we have ^{t) = ^(ti) < 0. This finishes the proof of 
Theorem 15.31 □ 



9.2 The proof of Theorem 15.4 



In this section we assume that the controlled pair {x{t),u{t)), with t G [to)^i]) solves the 
OCP flP reip . Recall that we assume that x{to) = (a;(to), ai(io)) = (0o(-2o))O) and x{ti) = 
= {4>i{wo) , x{ti)) , where (pi are base projections of algebroid morphisms : 
TSi E ioT i = 0, 1. We use the following notation Sq := $o(T^oS'o), Si := $i(T,u;qS'i), 
A^ := R+i-dt) C T^R, and K"^ := conv {Bt,t,iSo © %to)), }• 

Theorem 9.6. Let {x{t),u{t)), fort G [toji^i]; be a solution of the optimal control problem 
(IP reip . Then the convex cones /C^ and Si © ^x{ti) can he separated for any r G (to^i) 



which is a regular point ofu. 

Proof. The argument is very similar to that from Theorem 19. 1[ 

Assume that {x{t),u{t)) is a solution of ( IP reip but the cones /C" and Si © ^x(ti) are 
not separable. First, construct a family of admissible paths s bo{s,p) G E parametrised 
hj p E Sq such that the following conditions hold: 

• the family is uniformly regular w.r.t p at s = 0, 

• ^o(0,p) = p, 

• bQ{s,p) lies in the image of $o- 
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A family with the desired properties can be build as follows. First, choose a linear 
subspace V C T^^S'q such that $o|y '■ V Sq = ^o{TzoSo) is a linear isomorphism ($o at 
Zq is a linear map from TzqSq to Sq C Ex(to))- For p & Sq take v{p) = ($o|y)~^ (p) ^ ^ 
and consider a curve s H- 2;(s,p) = exp^^(s ■ v{p)) in 5*0, where exp^^(-) is an exponential 
map around zq defined for some metric on 5*0. We define bo{s,p) := ^o{dsz{s,p)). 

Let us check that bo{s,p) has the desired properties. Clearly, it lies in the image of 
$0- The properties of the exponential map imply that s i-^ 'z{s,v) = ds (exp^^{s ■ w)) is 
a family of paths uniformly regular at s = w.r.t v. These paths are admissible in the 
tangent algebroid TSq. Now, since bQ{s,p) is obtained as a composition of J{s,v) with 
a continuous map p h-> v{p) and a smooth map $0) the uniform regularity is preserved. 
Since $o is an algebroid morphism, also admissibility is preserved. Finally, observe that 
6o(0,p) = $0 [d,\oexp^^{s-v{p))] = $o(^'(p)) = $o (('^'ok)"^) (p) = P- 

Similarly, we construct a family of admissible paths s h-> bi{s, q) E E parametrised by 
q & Si and such that the following holds: 

• the family is uniformly regular w.r.t g at s = 0, 

• ^i(0,g) = g, 

• q) lies in the image of $i. 

If the cones A3" and Si © A^(f^) are not separable, by Lemma FD. 61 there exists a vector 
k G /C" n [Si © ^x{ti)) and vectors Ci, . . . e^i G © such that 

• span{ei, . . . ,emi,5i} = E^(ti), 

• fc ± Cj G /C" for ? = 1, . . . , nil. 

In the last formula we understand k+Ci as fc+(ej+6'^(j^)), where ej+6'^(j^) G -E2;(tj)©T^(j^) = 
Aa;(t^). In view the first property, we can decompose E^^{t^-) ^ = M™^ © M™^ = 
span{ei, . . . , 6^1} © and choose a basis (ci, . . . , 6^2) of '^i. 

Without the loss of generality (cones are invariant under rescaling) we may assume 
that k projects to —dt under prpj^ : A = E ^ TM — )■ TM. Observe that the i?-projection 
^0 := P_b(^) belongs to Si. 

Introduce bo(s,p) := (^o('5,p),0) G x TM = A. We can consider variations 
f{x(t,s,p),u'^{t)) associated with symbols tti = {Ti,Vi,T,6ti,6t)i=i ^^^^k and initial base- 
point variations Xo{s,p) = T{bo{s,p)) as in Theorem 17.41 From (17. 2p . there exists a family 
of A-paths s i-^ cr°'P{s) defined for < s < 6* such that 

[bo(s,p)].G[o,e][/(a;(t,e,p)),<(t)]tg[to,ti+£<5t] . 
= [/(a.(t),n(t))),,[,„,,]K'^(s)],,[o,.], ^ ■ ^ 

Observe that, due to (17. 3p . d'^'P(O) G A3" and, moreover, all elements of A3" can be obtained 
in this way. 

Choose symbols tt), rOj, and Dj and elements p,Pi,Pi G iSq such that ^"'^(0) = k, 
<i"''P'(0) = k + Bi, and ^"''^'(0) = — Cj. Since we deal with a finite set of symbols, we 
can assume that they all are of the form {Ti,Vi,T,Sti,St)i=i^,,,^k, where Tj, Vi, r, and k are 
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i=l / i=l i=l 



mi \ mi mi 



fixed, and that they differ by Sti and St (see Remark 17. 3p . Define for any r = r'^Ci G 
B^^iO, 1) © e^, = {f: \\f\\ = J2i \r^\ < 1} C a new symbol 

( m \ m m 

and a new element of 5i 

\ j=l / i=l 4=1 

where h~^{r) = max{r, 0} and h~{r) = max{— r, 0} are non-negative. From (17. 3p we get 

^w{f),pirl^Q^ = fc + r. 

Now form Theorem 17. 4l there exists 9 > such that d^^^^'^^^^^s) is well-defined for < s < 6* 
and all r G i?''"^(0, 1) © and, moreover, it is uniformly regular w.r.t. r at s = 0. 

Repeating the reasoning from the proof of Theorem 19.11 we can show that the TM- 
projections ^'"'■'''''^'•^(s) satisfy 

r^''\s)ds < (9.5) 



for all e < ?7 and all r G B"^^ (0, 1), where < rj < 6 is a fixed number. 

Projecting d^^^'P^^(s) to E we obtain a family of bounded measurable admissible paths 
uniformly regular at s = w.r.t. f G 5™i(0, 1) © C M"*, and such that 

^w(r),p(r)jQ) = r + fco e ~ ^x(r)- 

For 

m2 

s G © S'"2(0, 1) = {s = X e^s' G 5i : ||^| = ^ < U 

j=l i 

we have a family of i?-paths s i— 6i(s, s + ko). This family is uniformly regular w.r.t. s at 
s = and, moreover, 6i(0, s + ko) = s + ko. 

The families a^(s) := (f°^^'P^^{s) and bg{s) := bi{s,s + ko) satisfy the assumptions of 
Lemma [8. 2 [ and hence there exist vectors fo, sq and a number < e < ?7 such that 

Projecting equality (19. 4p (for To = tti(ro) and p = p(ro)) to E and using the above equality, 
we get 

[/(x(t), n(t))]^gj^^^_^^] [bi{s, So + ko)]se[o,e]- 

Since bo{s,p{fo)) lies in Im$o and 6i(s,So + ko) in Im$i, the trajectories f {x{t) , u{t)) , 
with t G [toi^i], and f{x{t,e,p{fo)),u^^^°\t)), with t G [to,ti + e6t{fo)], are iJ-homotopic 
relative to ($0)*^'i)- On the other hand, from (19. 5p we deduce (in the same way as in 
the proof of Theorem 19. ip that the cost on the first of these trajectories is smaller. This 
contradicts the optimality of {x{t),u{t)). □ 
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Now, as a simple consequence of Lemma [9.4[ we obtain the following result. 



Lemma 9.7. Let t G [to, t] be any regular point of the control u. Then 



K'l C cl {K"^) . 



Proof. By Lemma [9. 4^ C cl(i^"), and hence 



K'l = conv{A,to('5o © %o))> Kn C conv{cl(Aiio(5o © %io))), cI{K:)} 
= cl (conv{Bt,t„ {So © %to)), K^}) = cl (K) ■ 



□ 



The above result allows us to define a convex cone 




U ^1 (^r) 



T<ti, T regular 



in Ax(tj^)- Similarly as in Section [QTl we have the following result. 
Lemma 9.8. The the convex cones /C"^ and Si © ^x{ti) o-f^ separable. 



Proof. If 1C^^ and Si © ^x{ti) were not separable, then, by repeating the argument from 
the proof of Lemma [9. 5^ the cones cl(/C") and Si (B ^x{ti) would not be separable for some 
regular t < ti. Consequently, also /C" and Si © ^x{ti) would not be separable (Lemma 



Now we can finish the proof of Theorem 15.41 From the previous lemma we can deduce 
that there exists a covector $,{ti) G ^^(j^) separating /CJ*^ and Si © A^(t^); i.e., 

(d, i{ti)) < < (s, $,{ti)) for any d e /Cj; and seSi® A^(t,). 

We define ^{t) := S*^^(ti). Now, since C K^^ and A^^t,) = ^x(ti) © ^ 
Si © Ax{ti), the covector ^(ti) separates also K^^ and Ax{ti). Consequently, ^(t) satisfies 
the assertion of Theorem 15.31 On the other hand, the separating covector ^(ti) must 
vanish on the linear subspaces B^_^^{Sq © Ox{to)) ^^^1 Si © Ox{ti) C 5i © A^(f^), which 

gives additional conditions from Theorem 15.41 □ 




□ 



Appendix A 



DifFernetial geometry 



A.l Lie groupoids 



In this section we give the definition of a Lie groupoid, study some fundamental ex- 
amples and recall the construction of a Lie algebroid of a Lie groupoid. Later we ad- 
dress some questions about integrability of Lie algebroids. The discussion is based mostly 
on [Mackenzie ,^005 . 

Lie groupoids 

Definition A.l. A Lie groupoid consists of two manifolds: Q (a groupoid) and M (a 
base), together with two surjective submersions a,l3 : Q — > M called the source and the 
target maps, a smooth map t : x ^ tx, M — > Q, called the inclusion map, and a smooth 
partial multiplication {h,g) i-> hg, Q * Q = {{h, g) & Q x Q : a{h) = f3{g)} — > Q, subject 
to the following conditions: 

• a{hg) = a{g) and P{hg) = f3{h) for all (h,g) *Q; 

• the partial multiplication is associative; i.e., j{hg) = {jh)g for all j, h, g such that 



• a{Lx) = = X for all x G M; 

• i is a two-sided identity; i.e., gLa(g) = i'i3{g)g = g for all g E Q; 

• each g & Q has a two-sided inverse g~^ G Q such that a{g~^) = fi{g), f}{g~^) = a{g), 
g~^g = i^aig), and gg~^ = Lp(^g). 



fop = p o F, and preserves the multiplication; that is, F{h)F{g) = F{hg) for all 



From the point of view of category theory, a groupoid may be regarded as a small 
category with the set of objects equal to M and the set of arrows equal to Q, and such that 
all the arrows are invertible. The word "Lie" refers to the fact that the groupoid structure is 
compatible with the smooth structures on M and Q (similarly as a Lie group is a group with 



(j, h), {h,g) eg*g; 




— > Q and 
a o F and 



{h,g)eg*g. 
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a smooth structure compatible with the multiplication). It is an easy exercise to show that 
the assumption that a. and /9 are surjective submersions imply that = (a x /3)~^(Aa,/) 
has a smooth structure of a submanifold ofQxQ. Moreover, it follows from the smoothness 
of the partial multiplication and the properties of a and /3 that the inverse mapping 
g I— is a diffeomorphism. Details can be found in [Mackenzie, 20051 - 

Lie groupoids appear naturally in many situations. A basic example is a Lie group G, 
with M = {pt} being a single point, trivial a and /3, and group multiplication. Another 
standard example is a pair groupoid Q = M x M oi a manifold M, with the source 
a{x, y) = y, the target f3{x, y) = x, and the multiplication (x, y){y, z) = (x, z). 

For a (right) principal G-bundle G — y P M we can construct an important 
example of a gauge groupoid Qp = P x P/G over M. In Qp we identify pairs {p,q) and 
[pg, qg) for all p,q E P and g E G. The source and target maps are simply a[{p, q)] = 7r(g) 
and P[{p,q)] = 7r(p), and the multiplication reads as [(p, 5')][(q', t)] = [(p, r)]. For the 
two extreme cases: (P = M, G = {1}) and {P = G, M = {pt}), Qp is the pair groupoid 
M X M and the Lie group G, respectively. Note that Qp can be regarded as a pair groupoid 
P X P divided by the action of G (all the groupoid data for P x P is G-equivariant). 

For a Lie groupoid Q and a; G M we may define an a-fibre of Q over x 

Qx ■= {g ^ Q a{g) = x} eg. 

Note that is a closed embedded submanifold of Q. The groupoid Q is called a-simply 
connected if each of it a-fibres is simply connected. 

Take now an element g E Q. A right translation corresponding to g is Rg : Qfi^g) — > 
Qa{g) defined simply as /i i— )■ hg. 



A Lie algebroid of a Lie groupoid 

In this part we describe the construction of a Lie algebroid of a Lie groupoid basing mostly 
on [Mackenzie, 2005 Silva &: Weinstein, 1999 . The procedure follows closely the standard 



construction of a Lie group-Lie algebra reduction. 

Consider a Lie groupoid Q over M and the right action of Q on itself. Since the right 
translation Rg : Qp{g) — )■ Qa{g) is a diffeomorphism of a-fibres (not the whole Q) there is a 
sense speaking of right-invariant vector fields on Q only for fields tangent to a-fibres. 

Denote by T"^ := kerTa C the distribution tangent to the foliation of Q by a- 
fibres Q"" = {a~^{x) : x G M}. A vector field X G Sec(T"^) is said to be right-invariant 
if {TRg){X{h)) = X{hg) for all {h.,g) eQ *Q. The set of right-invariant vector fields will 
be denoted by 'X.r{Q). Observe that a right-invariant vector field is uniquely determined 
by its value along the identity section l{M). Indeed, we have X{g) = {TRg)X{Lp(^g)). 
Consequently, we can identify the space X/j(^) with the space of sections of the bundle 
A{g) := T"^|,(M) M 
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Since A{g) — ^ M is a pullback of T"^ — ^ ^ via i : M 

A{g) -T"^?, 



G, 



M 

it has a smooth vector bundle structure induced from T^Q. What is more, since the 
Lie bracket of right-invariant vector fields on Q is again right-invariant, the Lie bracket 
on Xr{Q) induces a natural skew-symmetric bilinear bracket [-, ■] on sections of A{Q). 
This bracket satisfies the Liebniz rule fl2.ll) for p = T/3|^(g). The bundle A{Q) — t- M, 
together with [-, ■] and p, is a Lie algebroid called a Lie algebroid of a Lie groupoid Q. Lie 
algebroids which come from some Lie groupoid by the construction described above are 
called integrable. 

Note that the maps TRg-i : TgG — )■ T^^^^^Q = defined point-wise for all g E Q 



give rise to a vector bundle map {reduction map) 



T"^ 

T/3 

TM- 



n 



id'T 



p 

-TM 



(A.l^ 



which is a fibre-wise isomorphism. 

The construction of A{Q) can be repeated also for the left action of Q and left-invariant 
vector fields. It is a matter of convention which construction we use. 

Natural examples of Lie algebroids are, in fact, associated with Lie groupoids. A Lie 
algebroid associated with a Lie group G is its Lie algebra g ~ TgC. For the pair groupoid 
M X M, a-fibres are simply a~^{x) = M x {x}, and hence T^G ~ T^-M. A Lie algebroid 
associated with this groupoid is the tangent algebroid on TM — y M. A Lie algebroid 
associated with the gauge groupoid is called an Atyiah algebroid. It will be described 
in detail in Section IA.2I 

We have shown above that to every Lie groupoid Q corresponds a Lie algebroid A{Q). 
In fact, also every Lie groupoid morphism F : Q — )■ Q over / : M — M induces a 
natural morphism of Lie algebroids A{F) : A{Q) — > AIG) over / : M — > M which can 
be described as follows. Since F preserves the source map, the vector bundle morphism 
TF : TQ — y TQ restricts to 



Now, since i o F = / o i, the derivative T"F induces a map of puUbacks A{F) : A{g) = 
L*T°'Q — y vA(^) = T^T^Q over / : M — > M. One can check that this is a morphism of 
Lie algebroids. Lie algebroid morphisms of the form A{F) are called integrable. In fact 
the association of a Lie algebroid A{G) to a Lie groupoid Q, and a Lie algebroid morphism 
A{F) to a morphism of Lie groupoids F is a functor form the category of Lie groupoids 
to the category of Lie algebroids. In literature it is known as a Lie functor. 
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Lie theory 

Since a Lie groupoid-Lie algebroid reduction can be considered as a generalisation of the 
Lie group-Lie algebra reduction, it is natural to ask a question about possible exten- 
sion of Lie integrability theorems to this new context. This topic is extensively treated 
in [Mackenzie, 2005] and solved by [Crainic Fernandes, 2003 . In this work we are in- 
terested in two problems: 

• Integration of Lie algebroids — does every Lie algebroid is a Lie algebroid of some Lie 
groupoid? 

• Integration of Lie algebroids morphism — can we lift a morphism of two integrable 
Lie algebroids to a morphism of the corresponding groupoids? 

The answer to the first problem is in general negative. A complete solution was given by 
[Crainic &: Fer nande s, 2003] (see also [Almeida, 1980 Almeida &: Kumpera, 198T Almeida &: Molino 



Mackenzie, 1987nCattaneo fc Felder, 2004| ). The idea goes back to covering theory. Re- 



call that the universal cover X of a topological space X can be constructed as a space of 
homotopy classes of paths emerging from a fixed point xq & X. U X = G is a Lie group, 
each sufficiently regular path in G can be reduced to a path in g — its Lie algebra. Now it 
turns out that the homotopies of paths in G can be reduced to homotopies in g, which are 
expressed entirely in terms of the Lie algebra structure, without referring to the structure 
of the underling Lie group. Consequently, the universal cover G of G can be defined as 
the space of paths in g divided by the equivalence relation coming from homotopy. The 
group structure on G is given by the composition of paths [Duistermaat &: Kolk, 2000 



The same construction can be repeated for Lie algebroids, yet we have to use admis- 
sible paths and algebroid homotopies (see Chapter [3]). The quotient space, with the 
multiplication defined by the composition of admissible paths, has a structure of an a- 
simply connected topological groupoid. Unlike to the case of a Lie algebra, there may be 
some obstructions to introduce a smooth structure on this groupoid. These are described 
in [Crainic &: Fernandes, 2003 . Theorem 13.61 is closely related with the ideas sketched 



above. Note, however, that we work in a measurable category, whereas Crainic and Fer- 
nandes use the smooth data. 

The second integrability problem has a positive solution under mild topological as- 
sumptions. 

Theorem A. 2 ( [Mackenzie &: Xu, 2000| ). Consider Lie groupoids H over S and Q over 
M , and suppose that $ : A{l-i) — >■ A{Q) over f : S — y M is an algebroid morphism. If 
"H is a-simply connected, there is an unique morphism of Lie groupoids F : l-i ^ Q over 
f : S — > M such that A{F) = $. 

We shall now study groupoid morphisms "H — > ^ in a special situation when TL = SxS 
is a pair groupoid. From Theorem IA.2I we can easily derive the following result. 

Lemma A. 3. Let $ : TS — > A{Q) over f : S — > M be a morphism of Lie algebroids. 
Then, if S is connected, there is at most one morphism of Lie groupoids F : S x S — y Q 
integrating $. If S is simply connected then such a morphism F exists. 
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Proof. If 5* is simply connected, the existence of F follows immediately from Theorem 
IA.2t as the groupoid S* x S* is a-simply connected (a-fibres are of the form S x {xq}). 

Assume now that S is an arbitrary connected manifold and let F : S x S — > Q be 
a morphism integrating $. Consider the universal cover vr : [S^Xq) — y (5, Xq). Clearly, 
SxS ^ SxS is a groupoid morphism, hence also the composition SxS — > SxS — > Q 
is a groupoid morphism. Moreover, it integrates the Lie algebroid morphism TS 
T^-^^(^). We will prove that uniqueness of F o (tt x vr) (following from Theorem IA.2|) 
implies the uniqueness of F. To see this, observe that if F o (tt x tt) = F o (tt x tt) then 
the set of points in S* x on which F and F coincide would be: closed, since F and F 
are continuous; nonempty, since F{xq,Xq) = F {xq,Xq) = if{xo)', and open, since vr x tt is 
a covering. We deduce that it is the whole SxS. □ 



Observe now that, if F : S* x S* — Y Q, with S connected, is a groupoid morphism 
integrating $ : TS* — > A{Q) over / : S — > M, then, for each xq E S , ^ : x ^ F{x, Xq) is 
a map from S to the a-fibre Qf{xo) oi Q such that the following diagram of vector bundle 
morphisms commutes 



T (^/(xo)) 




(A.2) 



Note that, if $ : S" — y Gf{xo) is a smooth map such that (IA.2P is satisfied, then F^{x, y) := 
is a groupoid morphism F^ : S x S — > Q integrating $. 
By Lemma lA.31 Fj is unique. Consequently, if $, $' : 5 — > Gf{xo) are two maps 



satisfying (1A.2|) . they are related by ^(x) 



'^^{y) = $'(x)~^$'(?/), and hence 



Corollary A. 4. Let S be a connected manifold. If a Lie algebroid morphism $ : TS — ?■ 
A{S) over f : S ^ M is integrable then, for each Xo,yo ^ S and g G a~(/(xo)) H 
/3~^(/(yo))j there exists a unique smooth map $ : S — > Qf{xo) = o.~^{f{xo)) such that 
7^oT$ = $ and $(i/o) = 9- 

Conversely, if ^ as above exists (for some Xq, yo and g), then the Lie algebroid mor- 
phism $ is integrable. In particular, such $ exists if S is simply connected. 



A.2 The Atiyah algebroid 

In this section we describe the Atiyah algebroid — a Lie algebroid canonically associated 
with a principal bundle. In particular we study its Lie bracket and give a description of the 
associated linear Poisson structure. Our discussion is based mostly on [Mackenzie, 2005 . 
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Invariant vector fields 

Definition A. 5. A principal bundle G — )■ P M is a locally trivial fibre bundle 
TT : P — > M, equipped with a (right) free action of the Lie group G on P; {p,g) t— )■ pg; 
P X G — y P such that its orbits coincide with the fibres of vr. 

Observe that if G — > P ^ M is a principal bundle, the action of G on P induces the 
action on the tangent bundle TP. Denote this action by Rg. The quotient space TP/G 
has a natural structure of a vector bundle over M. We define the addition simply by 

[Xp] + [Ypg] = [RgXp + Ypg] 

and the base projection by 

[Xpj^nip). 

It is straightforward to verify that the above constructions are well-defined. 

Observe that section of the quotient bundle E := TP/G — )■ M can be canonically 
identified with G-invariant vector fields on P. Note that, since G-invariant vector fields 
on P are closed under the Lie bracket [-, ■]tp, we have an induced bracket [-, ■]e on the 
space of sections of E. Clearly, [■,-]e inherits the skew-symmetry and the Jacobi identity 
form [-, -Jtp, and hence (Sec(£'), [■, -J^;) is a Lie algebra. Moreover, since for any G-invariant 
vector fields X, F G X'^(P), and every base function / G G°°(M) we have 

[X,7r*fY]^p = TT*/ [X,F]tp + (T7r)(X)(/)y, 

and the derivative (T7r)(X)(/) depends only on the class of X, the bracket [•, -js satisfies 
the Leibniz rule 

mj[Y]]^ = f[[x],[Y]]^+p{[x])ifm 

where the anchor map p : E ^ TM is defined by p([X]) = T7r(X). Clearly, p satisfies 
also the compatibility condition (12. 2p . 

To sum up, the bundle E = TP/G — > M, together with the bracket {E, [-, ■]e, p), and 
the anchor map p : E — > TM is a Lie algebroid. 

Definition A. 6. The Lie algebroid structure on tt : TP/G — > M described above is 
called an Atiyah algebroid of the principal bundle G — )■ P M. 

As has been already mentioned the Atiyah algebroid can be also described as a Lie 
algebroid associated with the gauge groupoid Qp. Now, we shall investigate this structure 
in detail. 

The Atiyah sequence 

Observe that, since G acts on the fibres of tt, the action Rg restricts to the space VP C TP 
of vertical vectors (i.e., vectors tangent to the fibres of vr). Since VP is spanned by 
the fundamental vector fields of the G-action on P, we have a canonical isomorphism 
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VP ^ P X g, where q is the Lie algebra of G. The action Rg in this identification reads 
Rg{p,a) = {pg, Adg-ia), so K := VP/G ~ P Xq q, where the right action of G on g 
is H- Adg-i. What is more, the bracket of two G-invariant vertical vector fields on P 
corresponds, in this identification, to the canonical (right) Lie bracket [-, -Jg on g. That is, 
if x H-> (x, a{x)) and x i— > (x, b{x)) are two G-invariant sections of P x g ~ VP, then 

[(x, a(x)), (x, &(x))]tp = (x, [a(x), &(x)]g) G P x g. 

This shows that the bundle is a Lie algebroid with the trivial anchor and the Lie algebra 
structure in fibres isomorphic to g. Alternatively, we may argue that the sections of K 
can be identified with G-invariant vertical vector fields on P, which are closed under the 
Lie bracket. The Lie algebroid structure on K is thus the restriction of the Lie algebroid 
structure on TP/G to vertical vector fields. Hence, we get the following (exact) sequence 
of Lie algebroid morphisms called the Atiyah sequence: 

^ K := P Xg Q ^ E A TM ^ 0. 



Local description 

Introduce now a local trivialisation 6^ : V x G ^ P\v obtained from a local section 



\s{V), 



s : y — 7- P by the formula (f)s{x,g) = s{x)g. Clearly, we may identify E\v with TP| 
thus E\v — TM\v X Q. For two local sections x H- (X(x),a(x)) and x H- {Y{x),b{x)) in 
this trivialisation the Lie bracket reads as 



[(X, a), {Y, b)]^ = i[X, Y]tm, [a, b], + X{b) - Y{a)) (A.3) 

and the anchor is p((X, a)) = X. In fact, this is just the product of the Lie algebroids 
TMlv — y V and g (cf. the last paragraph of Chapter We have a similar description 
globally if the principal bundle P is trivial. Note, however, that, if we will work with 
principal bundles over a neighbourhood of a path in M, we can always assume that our 
principal bundle is trivial. 

In some applications one has to work with a principal connection on P. It corresponds 
to a G-invariant horizontal distribution in TP and is represented by a splitting E = 
TM (Bm K given by a bundle embedding V : TM — )■ E such that p o V = idxA/- If the 
bundle K is trivial, then we get another trivialisation E ~v TM x g, associated with the 
connection V, in which the Lie bracket reads as 

[{X, a), (y, b)]^ = {[X, Y]tm, Pv(X, Y) + [a, b], + X{h) - Y{a)) ; (A.4) 

where Py is the curvature of the connection V, i.e., 

Pv(X, Y) = [V(X), V{Y)]e - V ([X, y]TM) . 

The anchor map is still simply p((X, a)) = X. 

Observe that formula (1A.3|) is a special case of ( ]A.4|) . Indeed, we may regard a local 



section s : V — > P as a G-invariant horizontal local distribution on P obtained by 
spanning Ts C TP by the G-action. Clearly the curvature of this distribution vanishes, 
and hence (lA.4p and (1A.3P coincide in this special case. 
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The linear Poisson structure 

Now we shall describe the linear Poisson structure H^; on the dual bundle E* = T*P/G — ?■ 
M canonically associated with the Lie algebroid structure on TP/G. 

Suppose for simplicity that the vertical subbundle K = VP/G is trivial (e.g. P is 
trivial), K = M ^ and consider a splitting E ~v TM ®m K induced by a principal 
connection V : TM — )■ E, so that we get an identification E ~v TM x q. Let E* ~v 
T*M X Q* be the corresponding identification of the dual bundle. 

Theorem A. 7. The Poisson tensor He associated with the Lie algebroid structure on E 
in the identification E* ~v T'M x q* reads as 

Ue{p.,C) = (n^M(p.) + X nr(C), 

where p,,. G T*M, ^ G g*. IIt*m o-nd are the standard Poisson tensors, and Vi \ 

is the two-form (^(, F\/{x){-, ■)) associated with the curvature F\/{x) : /\^ T^M — > g under- 
stood as a vertical tensor on TM. 

Consequently, the Hamiltonian vector field defined by means of He (ind a Hamiltonian 
h : TM X g* — ^ M reads as 

where with X^*^^ '^'^^ '^h '"^^ denoted the Hamiltonian vector fields associated with Poisson 
structures 11 7^ ^ ond Ilg. . 

In local coordinates, p ~ and ( ~ iCa), 



where F"f^{x) are the coefficients of the curvature Fy and G^^ are the structure constants 
ofQ- 

Proof. The proof is straightforward by an explicit coordinate calculation using the local 
description of the bracket and the anchor map (1A.4P and formula f l2.3p relating the bracket 
and anchor with the coefficient of the linear Poisson tensor. □ 
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Analysis 



B.l Mesuaralbe maps, regular points 



In this section we briefly recall some basic properties of measurable and absolutely continu- 
ous maps. Later we introduce a notion of uniform regularity and study its basic properties, 
li is a quite important technical tool in our considerations. 

Basic facts 

When speaking about measure we will always have in mind Lebesgue measure in M" or 
subsets of M". This measure will be denoted by fiii')- 

Recall that a map / : D M" — M'^, defined on a subset V C M", is measurable if the 
inverse image of every open set is Lebesgue measurable in V. The measurable map / will 
be called bounded if the closure of its image is a compact set. Observe that every bounded 
(or locally bounded) measurable function is locally integrable. 
Measurable maps can be characterised as follows. 

Theorem B.l (Luzin). The map f : R" D V — )■ R defined on a measurable set V is 
measurable iff, for every e > 0, there exists a closed subset F G V such that the restriction 
fir is continuous and fiL{V \F) < e. 

For the proof see [Lojasiewicz fc Ferreira, 1988| . 

In our considerations much attention will be payed to regular points of measurable maps. 

Definition B.2. Let / : [a,b] — )■ R"* be a measurable map. A point x G [a,b] is called a 
regular point (also: Lebesgue or density point) of /, iff 



For bounded measurable (or more generally integrable) maps we have the following result. 

Theorem B.3 (Lebesgue). For an integrable map f : [a,b] — )■ R™ almost every point in 
[a, b] is a regular point of f . 




For the proof see [Lojasiewicz fc Ferreira, 1988 
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A map X : [a, b] — )■ M.^ is called absolutely continuous (AC) if it can be written in the 
form ^ 

x{t) = x{a) + / y(r)dr, 

J a 

where v{-) is an integrable map. As we see, an AC map x(t) is different iable at all the 
regular points t oi v (hence, by Lebesgue Theorem, differentiable a.e.). Its derivative at 
such a point is simply v(t). In this work we concentrate our attention mostly on absolutely 
continuous maps with bounded derivative (ACB maps) i.e. maps for which f (■) is bounded 
measurable. 

In our considerations we will use the following lemma. 

Lemma B.4. Let a : [0, 1] — M 6e a bounded measurable map, let h : [0, 1] — t- [0, 1] 
be a continuous function, and let g : [0,1] — ?■ [0,1] be a C^-map with a non-vanishing 
derivative. Then the map 

s^G{s):= [ \a{g{t)h{s))-a{g{t)h{so))\dt 
Jo 

is regular (in fact continuous) at every Sq such that /i(so) 7^ 0. 

Proof. Let c be a number such that < c < [(/'(a;)] for every x E [0, 1]. Now if A C [0, 1] 
is a measurable subset then fiL {g~^{A)) < ^fiL^A). 

Choose 6 > 0. By Luzin Theorem IB. II there exists a closed set F C [0, 1] such that a(-) 
is continuous on F and /iL([0, 1]\-F) < e. Now a is uniformly continuous on F, g is bounded 
and h continuous, hence there exists 6 > such that \a{g{t)h{s)) — a{g{t)h{sQ))\ < e if 
only \s — Sol < S and t and s are such that g{t)h{s) G F and g{t)h{sQ) E F. As a 
consequence for |s — So| < 5, we can estimate 

f \a{g{t)h{s)) - a{g{t)h{so))\dt < [ 2||a||dt+ [ 2||a||dt+ 

Jo J {t:g{t)h{s)iF} J {t:g(t)h(so)iF} 

+ / \a{g{t)h{s)) - a{g{t)h{so))\dt 

J {t:g{t)h{s)eF}n{t:g{t)h{so)eF} 

< 2M ■ ' (^(10. 1] \ f )) ) + 21|a|| . (^([0. 11 \ F)) ) + / 

<£ 2 a 



c \h{s) h{sQ) ^ 

Since h{sQ) 7^ 0, if |s — So| is sufficiently small, the values s of G{s) are arbitrarily close to 
= G{so), which finishes the proof. □ 



Uniform regularity 

Regular points play an important role in our considerations, since the behaviour of a 
measurable map at a regular point is similar to the behaviour of a continuous map. To 
study behaviour of the families of measurable maps we introduce a notion of uniform 
regularity. 
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Definition B.5. Let P be a topological space and consider a map / : [a, 6] x P — )• M™' 
such that t i-T- f(t,p) is a measurable for every p ^ P. We call / uniformly regular with 
respect to p & P at x ^ [a, b] iff the following conditions are satisfied: 



1 r 

\t 



/ \fix + s,p) — f(x,p)\ds — >0 locally uniformly w.r.t. p, (B.l) 
Jo 

the map p^f{x,p) is continuous, (B.2) 



and for every compact set K C P there exists a number to > such that 

p (^[0,to] 3 s f{x + s,p)^ is a continuous map from K to L^{[0,to],R'^). (B.3) 

Usually in mathematics the word "uniform" means "in the same way for all parameters". 
In the context of regularity this can be expressed by the condition (1B.1|) itself. Therefore 
Definition IB. 51 is more specific then what one could expect under the name "uniform 
regularity". The sense of this definition is, however, to abstract several technical properties 
of measurable maps which are important from the point of view of this work. Since, 
according to our knowledge, the notion of uniform regularity is not a well established 
term, we hope that Definition IB. 51 would not be confusing. 

Let us now investigate some simple properties of uniformly regular maps. In what 
follows we will consider only uniform regularity at point G M and restrict our attention 
to parameter spaces P which are metric (we can think of P as of a subset of R'"). 

A basic example of a uniformly regular map is just a continuous map. 

Proposition B.6. Let P : R x P — y be a continuous map. Then F is uniformly 
regular w.r.t. p & P at s = 0. 

Proof. Condition flB.2p is obvious. Fix now a compact set Kp C P and restrict s to a 
fixed interval [0, to]- Since F is uniformly continuous on [0, to] x Kp, for every e > there 
exists S > such that \F{s,p) — F{0,p)\ < e if \s\ < 6 and for all p G Kp. Consequently, 



/ \F{s,p)-F{0,p)\<\t\e 
Jo 



for |t| < S and all p G Kp. This proves (IB. 21) . i.e., Jg \F{s,p) — F(0,p)\ - — > uniformly 
w.r.t. p G Kp. 

To check (IB.3|) observe that, by the uniform continuity of F on [0,to] x Kp, for every 
e > there exists 5 > such that |P(s,p) — F{s,p )\ < s for every s G [0,to] and all 
p,p' G Kp such that \p — p'\ < 6. Consequently, 

-to 

ds < 



/•to 

/ F{s,p) - F{s,p'] 
Jo 



for all p,p' G Kp such that \p — p'\ < 6. This proves (1B.3|) . □ 
Another simple example is the following. 
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Proposition B.7. Let / : M — )■ be a measurable map regular at s = 0. For p G P 

define f{s,p) := f{s). Then the map f is uniformly regular w.r.t. p E P at s = 0. 

Proof. Conditions (IB.l|) - flB.3|) are trivially satisfied. □ 
Below we discuss several ways of generating uniformly regular maps from given ones. 

Proposition B.8. Let /, : M x P — )■ be two maps uniformly regular w.r.t. p E P at 

s = 0. Then the sum f + g is also uniformly regular w.r.t p E P at s = 0. 

Proof. Property (IB.ip is clear since 

+ gis,p) - /(0,p) - giO,p)\ < \fis,p) - /(0,p)| + \gis,p) - g{0,p)\. 

Property (1B.2|) is obvious as the sum of continuous maps is continuous. 
To prove (1B.3|) fix a compact set K (Z P and assume that K 3 p ^ ([0, to] 3 -s f{s,p)) 
and K 3 p ^ ([0,to] 3 s 9{s,p)) are continuous. Without loss of generality to < Iq. 
Now the restriction K 3 p^ ([0,to] 3 s ?■ g{s,p)) is also continuous since 

||«(-)IUi{[0,io],IR™) ^ ll"(')llLi([0,io],IR'")- 



Consequently, K 3 p ^ f{-,p) + g{-,p) E L^{[0,to\,: 
continuous maps. 



is continuous as a sum of two 

□ 



Proposition B.9. Let / : M x P — > be bounded and uniformly regular w.r.t. p E P 
at s = 0. Let h : P — y be a continuous map. Then the map f{s,p) = h{p)f{s,p) is 
uniformly regular w.r.t. p at s = 0. 

Proof. Condition ( ]B.2|) is obvious. Choose now a compact set K G P. For p E K we have 



\h{p)f{s,p) - h{p)f{0,p)\ds < sup \h{p)\ 



|/(s,p)-/(0,p)|ds— >0 



uniformly w.r.t. p E K, and hence (IB.ip is satisfied. 
Finally, note that for p,p E K we have 



to 



h{p)f{s,p) - h{p )f{s,p 

to 



ds 



ds + 



< \h{p)\ r f{s,p)-f{s,p' 
Jo 

/•to 

<snp\h{p)\ f{s,p) - f{s,p') 
peK Jo 



h{p)-h{p) / f{s,p) 



to 



ds 



ds + 



h{p)-h{j)) f{-,p' 



+ 0: 



p^p 



that is, (1B.3P is satisfied. 



□ 



Lemma B.IO. Let / : M x P — R"* be bounded and uniformly regular w.r.t. p E P at 

s = 0. Consider f{s,p,c) := f{sc,p) where c E R. Then / : M x P x M — y is 
uniformly regular w.r.t. p E P and c G M at s = 0. 
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Proof. Since /(0,p, c) = /(0,p), condition (1B.2P is obvious. 

Consider now compact sets Kq C M and Kp C P. For c G J'i'c' and p G -ft'p we have 



1 



'0 



f{s,p, c) - /(o,p, c; 



ds = - / \f{sc,p)-f{0,p)\ds 



1 

1^ 



ds — ^0. 



f{s,p)-f{0,p) 

Since Kq is bounded and -W — /(0,p)| ds — > uniformly w.r.t. p G -ft'p, the 

above convergence is uniform w.r.t. p G -ft'p and c G -ftTc- 

We are left with the proof of property (IB. 31) . We will check that {p,c) i— f{-,p,c); 
Kp X Kc — > ([0, to]; IK™) is continuous separately w.r.t. p and w.r.t. c for a suitably 
chosen to- 

Let to > be a number from the property (1B.3P for f{s,p) and K = Kp. To prove the 
continuity w.r.t. p fix c G Kq. If c 7^ 0, then 



f{s,P, c) - f{s,p',c) 



ds 



f{sc,p) - f{sc,p) 



ds 



1 

c 



rtc 



f{s\p) - f{s\p') 



ds ^ 



if only tc < tf). 

For c = we have 



f{s,P, c) - f{s,p\c) 



ds 



/(0,p)-/(0,p' 



ds = Itl 



/(0,p)-/(0,p' 



for every t. In particular, we proved continuity w.r.t. p for to := 



to 



Now fix p G P, fix c G -ftTc , choose e > and consider c G If c =0, then 







/(s,;j, c) - f{c,p,c) 

■to 



ds 



= r\f{sC,p)-fiO,p)\ds=\to\^Jy- r f{s',p)-fiO,p) 
Jo |to C Jo 



ds — ^0. 



If c' 7^ consider a closed set F C [0,to] such that ([0,to] \ < e |to| and f(-,p,c') is 
continuous on F (note that p and c' are fixed). Such a set exists by Luzin Theorem IB.li 
Since f{-,p,c') is uniformly continuous on F, there exists a number 5 > such that 
f{s,p, c) — f{s',p, c) < e if |s — s' I < 5 and s, s' G F. Now f{s,p, c) = f{-jS,p, c) and 

< ^-7^ lto| for s G [0,to], so we have 



s - ^s 



/(s,p, c') - f{s,p,c) 



< e if |c' - c| < -^(5 and s G F fl —F. 

\to\ c 
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Note that 



l^L ([0, to] \ n < /ii ([0, to] \F)+^L (^[0, to] \ '^F^ 



<e\U 







c' \ r 1 . r 1 


|to| + ( 




+ -e\ to < 4:8 to 


c 





if |c — c I is small enough. Consequently, 



to 



fis,p,c) - f{s,p, c) 



ds 



< 



Fn—F 



f{s,P,c) - f{s,p,c) 



ds 



<e{\to\ 



fis,p,c) - fis,p,c') 



ds 



<e\to\+fiL (^[0,to]\Fn-Fj -2 

if |c— c'l is small enough. Since e is an arbitrary positive number, this proves the continuity 
of (p, c) I— )■ f{-,p,c) w.r.t. c. □ 

Lemma B.ll. Let / : M x P — > R™ be bounded and uniformly regular w.r.t. p E P at 

s = 0, and let G : M™ x M x P x Q — M™ be a continuous map w.r.t all variables. Then 
the composition G{f{s,p), s,p, q) is uniformly regular w.r.t. p E P and q E Q at s = 0. 

Proof. We will prove the assertion for G trivially depending on g G Q. This will suf- 
fice, since we can denote G{f{s,p),s,p,q) as G{f{s,p,q),s,p,q) = G{f{s,p),s,p), where 
f{s,p,q) := f{s,p) and p := {p,q) E P x Q. Clearly, f{s,p) is uniformly regular w.r.t. 
p = {p, q) E P X Q at s = (cf. Proposition IB.7P and the investigated composition has a 
desired simpler form G{f{s,p),s,p). 

Property flB.2p is obvious. To prove fIB.ip estimate 

\G{f{s,p),s,p)-G{f{0,p),0,p)\ 

< |G(/(s,p),s,p)-G(/(0,p),s,p)| + |G(/(0,p),s,p)-G(/(0,p),0,p)|. 

Since G{s,p) := G{f{0,p),s,p) is continuous w.r.t. p and s, it satisfies (IB.ip . Conse- 
quently, it is enough to check if 



\Gif{s,p), s,p) - G(/(0,p), s,p)\ds^O 



locally uniformly w.r.t. p. To prove it consider a compact set Kp C P and restrict s 
to the interval [0,to] C M. Since / is bounded, its image Im/ is contained in a compact 
subset K C M'". Fix s > 0. The map G is uniformly continuous on K x [0,to] x Kp, so 
there exists a number 6 > such that 



\G{x,s,p) - G{y,s,p)\ < e 
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if |x — y| < S and x,y ^ K, s & [0,to]; and p G Kp. Since f{s,p) is uniformly regular there 
exists a number < to ^ such that 

(B.4) 



f \f{s,p)-f{0,p)\ds<\t\-e-6 
Jo 



for every |t| < to and each p G Kp. Define now Ap := {s G [0,to] '■ \ f{s,p) — f{0,p)\ > 
From (1B.4P we have 

ft 



6-fiL{[0,t]nAp)< I \f{s,p)-f{s,p)\ds< I \f{s,p)-f{s,p)\ds<\t\-e-5, 
JY),t\r\Ap Jo 

hence hl ([0,t] fl Ap) < e • \t\. Consequently, for |t| < to; we have 

f \GU{s,p),s,p)-GU\Q.v),s,p)\<ls<2- sup \G\ f Ids 

Jo Kx[0,to]xKp J[0,t]nAp 



eds 



[0,t]\Ap 



<2- sup \G\- fXLi[0,t]nAp) +e\t\= e\t\ {2- sup |G| + 1 . 



Kx[0,to]xKp 



KxlO,to]xKp 



Since e > was arbitrary, this proves (1B.1|) . 

To prove (IB.3|) we proceed similarly. Again we restrict our attention to K x [0, to] x Kp 
and fix 5 > 0. Let 5 > be such that, for x,y & K, s & [0, to] and p,p ^ Kp 



G{x,s,p) - G{y,s,p' 



< e 



ii \x — y\ < 6 and \p — p'\ < 6. 

From the uniform regularity of f{s,p), there exists a number 6 > such that 

-to 



f{s,p) - f{s,p ) 



ds<e-5 



if p,p' G Kp are such that \p — p'\ < 5. From that we deduce that the set B^^' := {s G 
[0,to] : \f{s,p) — > 5} has measure smaller than e\i\p — p)\ <b. Indeed, we can 



estimate 



J B I 



f{s,p) - f{s,p') 



ds < 



to 



f{s,p) - f{s,p) 



ds<S- e. 



Therefore for \p — p'\ < min{5, 6} we can estimate 



to 



+ 



s,p) - G{f{s,p'), s,p' 



ds < 



B , 

pp 



Gif{s,p), s,p) - G{f{s,p'), s,p' 



ds 



[0,to]\B 



Gifis,p), s,p) - G{f{s,p'), s,p' 



ds 



<2- sup \G\-fiL{Bpp>)+ [" edsKeU- sup IGl + ltoM 

KxlO,to]xKp Jo \ Kx[0,to]xKp j 



This proves (1B.3|) . 



□ 
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B.2 Ordinary differential equations 

This section contains a revision of the theory of ordinary differential equations in a measur- 
able setting. We formulate standard theorems about existence, uniqueness and regularity 
of solutions. We state these results after [Bressan fc Piccoli, 2007 and give sketches of 
the proofs. 



Caratheodory solutions 

Consider an ordinary differential equation associated with a map g : x M — > R", 

x{t)=g{x{t),t). (B.5) 



By a (Caratheodory) solution of (IB.SP on an interval / = [to7^i] we shall mean an AC 



map t H- x{t) which satisfies (IB.Sp a.e. For the solutions in the above sense one can 
develop the standard theory of existence, uniqueness, and parameter dependence, as done 
in [Bressan fc Piccoli, 2007| . Let us recall the most important results of this theory. As- 
sume the following: 

t ^ g{x, t) is measurable for every x, and x ^ g{x, t) is continuous for every t; (A) 

g{x,t) is locally bounded and locally Lipschitz w.r.t. x; (B) 

that is, for every compact set K C x M there exist constants Ck and such that 
\g{x,t)\ < Ck and \g{x,t) - g{y,t) \ < Lk\x - y\ for every (a;,t), {y,t) e K. 

Theorem B.12 (existence and uniqueness of solutions). Assuming that ([X]) and ([B]) hold, 
for every xq G M" there exists a unique solution x{t, Xq) of (IB.5|) with the initial condition 
x{to) = Xq, defined on some interval [to,tQ + e]. If g is globally bounded and globally 
Lipschitz (so that the constants Ck and Lk in ([B]) can be chosen universally for all K's), 
then the solution is also defined globally. Moreover, if x{t, xq) is defined on the interval 
[to,ti] then so are the solutions xit^x^) for Xq close enough to xq. 

Sketch of the proof. The proof uses the standard Picard's Method. One constructs a con- 
tracting map 

: x{t) I — >Xo+ g{x{T), r)dr 

J to 

and uses it to define inductively a sequence of functions x^{t,XQ) = Xq, x^~^^{t,XQ) = 
Axo{x^(t,Xo)) which converges uniformly in t to the solution x(t,Xo). The length of the 
interval [to;^i] on which the solution is well-defined depends on the Lipschitz bound of 
g{x,t). The details can be found in Bressan Piccoli, 2007 Thm. 2. LI]. □ 
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Parameter dependence 

Consider now differential equation (IB.SP with an additional parameter dependence 

x{t)=g{x{t),t,s), (B.6) 
where : x M x R — y W^. Assume the following: 

t I— >■ g{x, t, s) , s I— >■ g{x, t, s) are measurable, and x t— g{x, t, s) is continuous; {A') 

g{x,t,s) is locally bounded and locally Lipschitz w.r.t. x; {B') 

that is, for every compact set K C M" x M x M there exist constants Ck, Lk such that 
\g{x,t,s)\ < Ck and \g{x,t,s) - g{y,t,s)\ < Lk\x - y\ for every {x,t, s), {y,t, s) G K. 



Theorem B.13 (parameter dependence). Assume that (Ai) and fli?'|) hold, and de- 
note by x{t,XQ,s) the solution of (IB.6|) for a fixed parameter s and the initial condi- 
tion x{tQ,Xo,s) = Xq (we know that such solutions locally exist by Theorem \B.12^) . Then 
the dependence Xq i— )■ x{t,XQ,s) is continuous, whereas, for any bounded measurable map 
s i-T- xo{s), the map s i— )■ x{t,xo{s), s) is also bounded and measurable for every t. 

Sketch of the proof. As before one constructs a sequence Xq, s) defined by means of 
the contracting map 

A^g^s-x{t)\ — ^xo+/ g{x{T),T,s)dT. 

J to 

The sequence converges to the solution x(t, Xq, s) uniformly w.r.t. t and Xq, which implies 
continuity of the solution w.r.t. the initial value. If Xq{s) is measurable w.r.t. s, so is 
the sequence Xo(s), s). The limit x{t,Xo{s), s) is measurable as a point-wise limit of 
measurable functions. Moreover, since A^q^s is a contraction, a;o(s), s)|| is bounded 
by a constant times ||a;o(s)||. Details can be found in [Bressan &: Piccoli, 2007 . □ 



Assuming higher regularity of g{x,t, s), one can prove a stronger result. 

Theorem B.14 (differentiability w.r.t. the initial value). Assume that the function 
g{x,t^s) satisfies and (B^), it is differentiable w.r.t. x, and the derivative |^(x,t, s) 
satisfies [Ai) and is locally bounded. Then the solution x{t,XQ, s) of (1B.6P is differentiable 
w.r.t. the initial condition xq. Moreover, the derivative ^(t,Xo,s) is continuous in xq, 
AC in t, and measurable in s. 

Sketch of the proof. We proceed again according to the standard method paying more 
attention to measurability. Consider a variation of (IB.6|) 

x{t) = g{x{t),t,s), 

y{t) = ^{x{t),t,s) 

with the initial conditions x(to) = Xq and |/(to) = id- The above equations satisfy the 
assumptions of Theorem IB.13t hence the solution x(t,Xo,s) and y{t,Xo,s) is a uniform 
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(in t and xq) limit of the Picard's sequence Xo,s) and y^{t,Xo, s). We observe that 
g-(t,Xo,s) = y'^{t,Xo,s), hence also ^(t,xo s) = y{t,xo,s). The derivative t/(t,xo, s) 
satisfies the regularity conditions by Theorem IB. 131 

Again a detailed proof (the only difference is the absence of the parameter s) can be 
found in [Bressan fc Piccoh, 2007| Thm. 2.3.2]. □ 



Gronwall Inequality 

At the end of this section we will recall the following classical result. 

Theorem B.15 (integral Gronwall Inequality). Assume that 6 : [0, T] — )■ M is non-negative 
and integrable, and for almost every t G [0, T] we have 

bit) <C ■ f 6(s)ds, 

JQ 

where C > is a constant. Then b(t) = a.e. 

For the proof see for instance [Evans, 2010 App. B]. 



B.3 £^-homotopy type equations 

In this section we consider linear PDEs of a special kind which are important in the notion 
of i?-homotopy. We study their solutions in a weak sense and address a question about 
the existence of the trace. 



£'-homotopy type equations 

Consider two functions a{t, s) and b{t, s) defined on a rectangle K = [to, ti] x [0, 1] 3 [t, s). 
We will treat a and b as M-valued, yet all results remain valid for M"-valued maps. Assume 
that a and b are bounded and measurable w.r.t. both variables separately. Let c{t, s) be 
a fixed continuous function on K. We will say that the pair (a, b) is a weak solution 
( W-solution) of the differential equation 

dtb{t, s) = dsa{t, a) + c{t, s)b{t, s)a{t, s) (B.7) 

if for every function if G C^{K) the following equality holds: 

b{t, s)dt(p{t, s) — a{t, s)ds(p{t, s) + c(t, s)b{t, s)a{t, s)(p{t, s) dtds = 0. (B.8) 



Observe that, since we assumed only measurability of a and b, the boundary values on dK 
are, in general, not well-defined. 
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Definition B.16. We say that a W-solution (a, b) of ( ]B.7|) has a well-defined trace if there 
exist bounded measurable maps ao,ai : [to7^i] — >" ^ and 607^1 • [0, 1] — > M such that, for 
every ip G C°°{K), we have 



b{t, s)dtip{t, s) — a{t, s)dsil){t, s) + c(t, s)6(t, s)a{t, s)i/j{t, s) dtds 
bi{s)ip{h, s) - bo{s)ij{to, s)ds + / ao(t)V^(t, 0) - ai{t)ij{t, l)dt. 

J to 



In such a case we will call (a, 6) a WT-solution of (1B.7|) . The maps ao? c^i and 60 ; &i will 
be called traces of a and 6, respectively. 



Remark B.17. Since the values of measurable functions are defined a.e. only, for a WT- 
solution (a, b) of (IB.7|) we will assume that the traces agree with the boundary values of 
a and 6, i.e. ao(t) = a(t, 0), ai(t) = a(t, 1), bo{s) = b{to, s), and bi(t) = b{ti, s). 



Existence of the trace and properties of WT-solutions 

Under certain regularity conditions, W-solutions of flB.7l) are, in fact, WT-solutions. 

Theorem B.18. Let a and b be a bounded W-solution of (1B.7P . Assume in addition that 
a and b satisfy the following regularity conditions: 



[ [ |a(t,s) - a(t,0)|-dsdt -> 0, [ [ |a(t, s) - a(t, 1)1 -dsdt -> , (B.IO) 

iin Jo ^ J. J^_^ e 6^0 



-dsdt ->0, /" f - ^ ..^.,1 

'to JO ^ J^^ J^_^ 

'1 rto+£ 1 /•! rti 



/ / \b(t,s) -b(to,s)\-dtds ^ 0, / / \b(t, s) - b(ti, s)\-dtds ^ 0. (B.ll) 
Jo J to ^ Jo Jt.^e ^ 

Then {a,b) is a WT-solution of flB.7p and the traces a{t,0), a{t,l), b{tQ,s), and b{ti,s) 
are well-defined. 

Proof. Fix an element G C°°{K) and choose e > 0. The idea of the proof is standard: 
we will approximate ip by another function ip G C^{K) and, using f lR8|) for ip and the 
regularity conditions, show that flB.Op holds with e-accuracy. 

Define a rectangle if^ := [to + e,ti — e\ x [e, 1 — C -fC, and choose a smooth "hat 
function" X[a,6] : [c^, &] — M which satisfies the following conditions: 

2 

X[a,b](a) = = X[a,b](&) = 0, X[a,6](t) = 1 for t G [a + e,b- e] and ||L)x[a,b]|| < -• 

Now define s) := X[io,ii](^) " X[o,i](-5)- Obviously, x = 1 on /r^, x e C^{K) and 
||-Dx[a,6]|| < f- Moreover, dtx{t,s) = for t G [to + — £], and s) = for 

s G [e, 1 — e]. 
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Now define := x ■ ^ ^^{K) and ip := {1 — x)"^- Decomposing ip = if + ip , we get 



K 



bdtip — adgip + cbaip 



dtds 



K 



bdtip — ad sip + chaip 



dtds - 



K 



bdfip — adsip + cbaip 



dtds 



bdti>dtds +11 adsijdtds —If cba'ipdtds =: Ii + I2 + Ls- 





' Ik J Jk J J k 

We will now concentrate on the tree last summands. Observe that 



cbaipdtds 



K 



cbaipdtds 



where C3 is a constant depending on ||a||, 
Now 



h = 1 1 adsipdtds 



<fi{K\K,)\\cbai,\\<e-C3, 
, and ||c||. 



adsipdtds 



K\K, 

a?/'9s(l — x)dtds + // a{l — x)dsipdtds. 
K\K^ J Jk\k^ 

The last summand can be estimated hy e ■ C2 in the same way as J3 (with C2 depending 
additionally on Now, since dsx{t, s) = for s G [£,! — £], 



We can write J4 as 



tl fS 



to JO 



aipdsX'isdt 



tl rl 



aipdsX^^sdt =: J4 + I^. 



to Jl-e 



h = I [a(t, s) - a{t, 0)^(t, 0)] dsXdsdt+ 

'to 



tl 



a{t,0)2p{t,0) 



to 



dsxds 



dt = Jq + / a{t,0)i){t,0)dt. 

to 



Now 



tl re 

/ {a{t,s) - a{t,0))ip{t,0)dsxdsdt+ 

'to Jo 

+ f f a{t,s){tlj{t,s)-^ljit,0))dsxdsdt=: Ij + h. 

J to Jo 



Clearly, 



rti re rti ne 

\h\< / / |a(t,s) -a(t,0)| ■ ll^ll ■ pxlldsdt < / / \a{t,s)-a{t, 

Jto Jo Jto Jo 



-dsdt, 
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so by assumptions it converges to as e — )■ 0. Finally, using \ip(t, s) — ip{t, 0)| < s ■ WDipW, 
we get 



\a\\s\\D^\\ ■ \\Dx\\dsdt < 



'to JO 

As a consequence, we get 



' [ \\a\\6\\Dtlj\\-dsdt < e ■ Cs- 

to Jo ^ 



a(t, 0)?/'(t, 0)dt as£-^0. 



to 



Analogous estimations can be done for I^. As a result we get that 



[a(t, 0)?/;(t, 0) - a(t, l)V^(t, 1)] dt 



to 



0. 



We can repeat the above considerations for Ii to prove that 



[b{to, s)ip{to, s) - b{ti, s)ij{ti, s)] ds 



0. 

£->0 



The estimations for Ji, I2 and J3 show that, for a fixed ip, the equality (IB.OP is satisfied 
with an accuracy converging to as e —> 0. □ 

For WT-solutions we can formulate an uniqueness result. 

Lemma B.19 (uniqueness of WT-solutions). Let a : K ^ be a bounded measurable 
map (w.r.t. both variables separately), and let bo : [0,1] M. be any bounded measurable 
map. Then there exists at most one bounded measurable map 6 : — j- M such that (a, b) 
is a WT-solution of (IB.7p . and b{tQ, s) = bQ{s). Moreover, the trace b[ti,s) is determined 
uniquely. 

Proof. Assume that b{t,s) and b{t,s) are two such solutions for a fixed a{t,s). The dif- 
ference 6b(t, s) := b(t, s) — b(t, s) is a bounded measurable map which is a WT-solution of 
the linear equation 

dtSb{t, s) = c{t, s)6b{t, s)a{t, s) (B. 12) 

such that 6b(to, s) = 0. Let us define B{t, s) := 0+ J^^ c(t, s)6b(t, s)a{t, s)dt. Clearly, B{t, s) 
is ACB w.r.t. t and measurable w.r.t. s. Moreover, we have dtB{t, s) = c{t, s)6b{t, s)a{t, s) 
in the sense of Caratheodory and, since B{t,s) is continuous w.r.t. t, also WT. Conse- 
quently, {B — 6b) satisfies dt{B — 6b) ^ and, since B{to, s) = 6b{to, s) = 0, we have 

- [[ {B - 6b){t,s)dtip{t,s)dtds = [ {B - 6b){ti,s)ilj{ti,s)ds (B.13) 
J Jk Jo 

for every i) E C°°{K). Taking ip{t,s) = 0(s), where E C°^{I), we get that J^{B - 
6b){ti, s)(f){s)ds = 0, thus B(ti,s) = 6b{ti,s) a.e. In the light of this observation (IB.13P 
reads as 



jj (B- ^b){t, s)dtij{t, s)dtds = 0, 
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for every ip G C°°{K). Since dtip can be an arbitrary smooth function, we conclude that 
B{t, s) = Sb(t, s) a.e. Consequently, 6b is a Caratheodory solution of ( ]B.12p . Now observe 
that 



\Sb{T,s) 



dt6b{t,s)dt\ < / \dt6b{t,s)\dt 



to 



\c- a\\6b{t,s)\dt, 



to 



which, in view of the integral Gronwall Inequality IB.lSj implies 6b = 0. 



□ 



Appendix C 



Control theory 



In this part we recall basic definitions from control theory. Later we formulate the Pon- 
tryagin maximum principle in its classical form. 

Definition C.l. A control system on a manifold M is a map 

f:MxU — >TM, (C.l) 

such that, for every fixed u & U, the map f{-,u) : M — y TM is a C^-vector field. We 
assume that f/ is a subset of some Euclidean space W and that the maps f : MxU — > TM 
and Txf : TM x U — > TTM are continuous. 

Choose now an admissible control, i.e., a bounded measurable function u : [toj^^i] — ^ U. 
We can consider a time-dependent differential equation on M 

x{t) = f{x{t),u{t)), 

with a fixed initial condition x{to) = Xq. The solution x{t) of the above is called a trajectory 
of a control system (IC.ip associated with the control u{t), and the pair {x{t), u{t)) is called 
a controlled pair. 

Let us now introduce the total cost of the controlled pair {x{t),u[t)) 

J{x{-),u{-)) = L{x{t),u{t))dt, 

J to 

where on the integrand L : M x U — > TM (the cost function)we put the same regularity 
assumptions as on /, namely, L : M xU — > M and T^L : TM x U — y M are continuous 
maps. 

Given two points Xq and Xi we can introduce an optimal control problem: 

minimise the total cost J {x{-),y{-)) over all controlled pairs {x{t),u{t)) ^—^ 
(with all possible time intervals t G [toj'^i]) s-t- x(to) = a^o and x{ti) = Xi. 

Let now Lq : Sq "-^ M and Li : Si "-^ M be two immersed submanifolds of M. We 
define the following OCP with general boundary conditions: 

minimise the total cost J' {x{-),y{-)) over all controlled pairs {x{t),u{t)) 
(with all possible time intervals t G [to,^i]) such that x(to) ^ •S'o and x(ti) G Si. 

Necessary optimality conditions for the problem (jp| are the following. 
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Theorem C.2 (the PMP). Let {x{t),u{t)), with t e [to,^i], be a controlled pair of flClT]) 
solving the optimal control problem ((p|. Then there exists a curve p : [toj^^i] — ^ T*M 
covering x{t) and a constant Po < such that the following holds: 

• the curve p{t) is a trajectory of the time- dependent family of Hamiltonian vector fields 
'^Ht for the canonical symplectic structure on T*M and Hamiltonians Ht{x,p) : = 
H{x,p,u(t)) , where 

H{x, p, u) = (f (x, u),p)+ poL (x, u) ; 



• the control u satisfies the "maximum principle" 

H{x{t),p{t),u{t)) = sup H{x{t),p{t),v) 

and H{x{t),p{t), u{t)) = at every regular point t of u; 

• if Po = the covector pit) is nowhere-vanishing. 

For the problem ((p| we have more specific conditions. 

Theorem C.3 (the PMP for general boundary conditions). Let {x{t),u(t)) , with t G 
[to,ti], be a controlled pair of (IC.1|) solving the optimal control problem (jP|. Then there 
exists a curve p : [to;^i] — > T*M covering x{t) and a constant Po ^ which satisfy 
the assertion of Theorem \C.2\ and, additionally, p{t) satisfies the following transversality 
conditions: p{to) annihilates Trc(to)So and p{ti) annihilates Tx{ti)Si. 



For the original proof of the above theorems we refer the reader to [Pontryagin et ai, 1962 



Recent references are [Agrachev fc Sachkov, 2004 and [Barbero-Linan fc Munoz-Lecanda, 2009 



Appendix D 



Geometry and Topology 



D.l Separation of convex cones 



Geometrically, Pontryagin maximum principle describes the separation of certain cones 
associated with the optimal control problem, which live in the fibres of the algebroid 
E'QTM, along an optimal trajectory. Therefore we need some technical results concerning 
the separation of convex cones. 

Definition D.l. Two convex sets Ki and K2 in a vector space V are separable iff there 
exists a non-zero covector E V* such that 



We say that Ki and K2 are strictly separable iff there exists a non-zero covector (p G V* 
and numbers a, 6 G M such that 



A basic fact from the theory of convex sets in a finite dimensional space is the following 

Theorem D.2 (separation). Two disjoint convex sets in a finite dimensional vector space 
are separable. If, in addition, these sets are closed, and one of them is compact, they are 
strictly separable. 



Lemma D.3. The convex sets Ki and K2 in a finite- dimensional space V are separable 
if and only if c\{Ki) and c\{K2) are separable. 

Proof. If fID.ip holds for every ki G Ki and /c2 G K2 then, since the weak inequality is 
preserved under taking limits, it also holds for every ki G cl{Ki) and k2 G cl{K2). 

Conversely, if (ID.ip holds for every ki G cl{Ki) and /c2 G cl(i^2), it is also true on 
smaller sets Ki C c\{Ki) and K2 C c\{K2). □ 

Definition D.4. By a cone in a vector space V we will mean a set K which is invariant 
under positive homotheties, i.e.. 





(D.l) 




for every ki G Ki and k2 ^ K2. 



For the proof see [Giannessi, 2005 . We will also need the following fact. 



t ■ k ^ K whenever k G K and t > 0. 
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Remark D.5. If two convex sets Ki and K2 in V are separable, and one of them, say 
i^i, is a cone, then the separating covector (p satisfies 

(ki, > > {k2, (f) for every ki G Ki and k2 G K2. (D.2) 

Indeed, since Ki is invariant under homotheties, the image ^{Ki) contains numbers arbi- 
trary close to 0, hence from (1D.1|) it satisfies > (^k2,(p) for all k2 G K2. On the other 



hand, if (ki^Lp^ < for some ki G A'l, then the image (^Ki^Lp^ would contain arbitrarily 
big negative numbers, and hence (ID.ip would not hold. 

Above observation has two simple but important consequences. First of all, the sep- 
arating covector ip vanishes on the intersection Ki fl K2. Secondly, if one of the sets Ki 
contains an affine subspace ki + S, where S* C is a linear subspace, then ip vanishes on 
S. 

Now we prove a geometric characterisation of non-separability in a certain geometric 
setting. 

Lemma D.6. Consider a vector space V = W (B"^, denote by A a ray in M spanned 
by a vector X, i.e., A = M+ ■ A C M, and let S G W be a linear subspace. Let Ki be a 
convex cone in V , and denote by K2 the convex cone 5" ©A. The cones Ki and K2 are not 
separable iff there exists a vector k & KiH K2 and vectors ei, 62, • . • , € W such that 

span{ei,e2,...,em,S'} = ly, (D.3) 
vectors k ± Ci, . . . , k ± Cm belong to Ki, (D.4) 

where we identify Ci E W with ei + 6EW(B^ = V. 



Proof. Assume that vectors /c, ei, . . . , satisfy conditions ( ID.SP and (lD.4p . If (/? is a non 



zero covector separating Ki and K2 then, due to Remark ID.Sj (p vanishes on k and S. 
Moreover, < (fc ± e,, = ±(ej, hence (^Ci, ip") = 0. Since spanj/c, ci, . . . ,en, S} = V, 
the covector ip is null, which gives a contradiction. 

The opposite implication is harder to prove. We will make an inductive argument with 
respect to dim S. 

Assume that dim 5* = ; i.e., K2 = © A = R+ ■ A. If Ki and K2 are not separable 
then 

span{Ji'i, \} = V and A G -ft'i. 

Indeed, if V' = spanji^i. A} C V, then a non-zero covector vanishing on V' will separate 
Ki and K2. Secondly, if A ^ i^i then, by Theorem ID. 21 convex sets Ki and {A} can be 
separated by a covector ip. Since Ki is a cone we have (ki^ip'^ > > {\,ip) for ki G Ki 
(compare Remark ID.Sp . hence ip separates also Ki and M+ ■ A = K2. 

We deduce that A G i^i, and that there exist vectors el, 62, . . . G K2 such that 
{A, ei, . . . , e^} is a basis of V. Obviously each e7 is of the form = ■ A + e^, where aj 
are numbers and {ei, . . . , e^} is a basis of W. 

Now fix i and consider a vector A — -^e^, where G N. If A — -^e^ ^ Ki for all A^ G N, 
then, by Theorem ID. 21 and Remark ID. 5| there exist covectors ipi\f such that 

(/ci, v^at) > for all ki G Ki and <^A — ^e^; '^n) < 0. 
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We may assume that all (fN are normalised to 1 and choose a subsequence converging to 
&V*. Clearly, ip^ is non-zero (it is normalised to 1) and 

(ki.Lpo^ > for all ki G Ki and ^A,(y9o) < 0, 

that is, (fo separates Ki and K2 = ]R+ ■ A against the assumptions. 

To sum up, we proved that Ki contains elements A, a^A + and A — -^Ci. It is clear 
that some convex combinations of these vectors, after rescaling, are of the form A + and 
A — Cj, where Cj is parallel to e^. 

Now consider dim 5* > . We can split S = S (B S , where S = M- s is one-dimensional. 
By Remark Id. 51 if Ki and K2 are separable, then the separating covector ip vanishes on S . 
It follows that Ki and K2 are separable in V if and only ii := Ki/S and := K2/S = 
S (B A. are separable inV' := V/ S' = W/ S' © M. By the inductive assumption there exists 
vectors k G Ki/S (1X2/8 and ei, . . . G W/S such that conditions (ID. 31) and flD.4|) are 
satisfied for W = W/S and K^. In other words, there exists a vector A; G S* © A, vectors 
Ci, . . . , G W, and numbers a, ai, hi such that vectors k + a-s, k + ai - s + Ci and k + bi- s — Ci 
belong to Ki and span{e^, . . . , e^, S} = span{e], . . . , e^, S, s} = spaii{W/S , s} = W. 

From convexity of Ki we deduce that k + ■ s G -ft'i. Now, either all numbers 3d±h 
are equal a, and then vectors k + a ■ s and = + (oj — a) ■ s satisfy the assertion, or the 
interval k + [c, d] ■ s, where a, Sd±hi. ^ J^, rf], is entirely contained in Ki. In the second case 



it is quite clear that some convex combinations of vectors k 
and k + hi ■ s — Ci are of the form k + ai - s + ei and k + bi ■ 
and Ci is parallel to e^. Therefore we are in the first case again 
The inductive argument is now complete. 



c- s, k + d - s, k + tti ■ s + Ci 



s — Ci, where 



c+d 

2 



□ 



D.2 Simple topological lemmas 

Lemma D.7. Every continuous map \I' : ^"^(0, 1) — )■ M'" which satisfies the inequality 

||^(f)_f||<l for all fe B''' (0,1), 

contains point G in its image. 
Proof. The map 

H{R,t) := {l-t)R + t^{R), 

where t G [0, 1] and R G 95™(0, 1) is a homotopy between 55"(0, 1) and *(95'"(0, 1)). 
Observe that \\H{R,t) - R\\ = - ^|| < |, hence 



H{R,t) 



> 



R 



H{R,t) - R 



1 1 
>!-->-, 
2-2' 



and consequently H takes values in \ {0}. 
Assume that ^ Im\t^. Then the map 



S{R,t) := ^{{l-t)R) 
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is a homotopy between 'i/(dB"^{0, 1)) and \l/(0), which takes values in Im$ C \ {0}. 
The composition 



HoS{R,t) = { 



jH{R,2t) fort<i, 
[5(^,2^-1) fort>i 



is a contraction of dB"^{0, 1) to the point \l/(0), which takes values in \ {0}. On the 
other hand, the sphere dB"^{0, 1) is not contractible in \ {0}. □ 

Lemma D.8. Let : fi"i(0,l) © W^^ © M™^ ^nd ^2 : Om, © ^"^^(0, 1) 

M'"^ © M."^^ be two continuous maps satisfying, for a fixed vector G M*"^ © W^"^ , the 
following inequalities: 

||*i(r) - (f+4)|| < \ /orf e5™H0, l)©^m2 and 
11*2(5) + 4)11 <^ /or se^„,©S'"^ (0,1). 

Then the images \m.^i and \m.^2 have a non-empty intersection. 
Proof. Consider a continuous map 

5"^i+"^(0, 1) = 5"i(0, 1) © 5™^(0, 1) 3 (f + s) ^ ^i(f) - ^2(-s) G 
Now 



pm2 



|\l/(f\ s) — (r + s) 



< 



^i(r) - (f + A;o) 
^'i(f) - ff+ 4 



*2(-^) - 
*2(-s) 



-s + ko 



< 

1 1 1 
<- + - = -. 
- 4 4 2 



By Lemma [D.7I point lies in the image of Consequently, \I^i(ro) = *2(^So) for some 
Vq and 5*0 . □ 
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admissible path, [H] 

integration, [2T] 

reparametrisation, [271 EH] 
AL algebroid, see almost Lie algebroid 
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algebroid homotopy, [TT] 1181 [96] 
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relative, [21 
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integration, [2T] 

uniqueness, [19] 
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for principal bundles, 
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principal bundle, [83] 
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as a linear bi- vector, [T2] 
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WT-solution, ^ 

existence, [UBl 

uniqueness, [98] 



